Nov 07 02:24:50 devstack cinder-volume[75593]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 07 02:24:50 devstack cinder-volume[75593]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 07 02:24:50 devstack cinder-volume[75593]: we strongly recommend against using it for new projects.
Nov 07 02:24:50 devstack cinder-volume[75593]: If you are already using Eventlet, we recommend migrating to a different
Nov 07 02:24:50 devstack cinder-volume[75593]: framework.  For more detail see
Nov 07 02:24:50 devstack cinder-volume[75593]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 07 02:24:50 devstack cinder-volume[75593]:   import eventlet  # noqa
Nov 07 02:24:53 devstack cinder-volume[75593]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75593) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 07 02:24:53 devstack cinder-volume[75593]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75593) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 07 02:24:53 devstack cinder-volume[75593]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75593) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 07 02:24:54 devstack cinder-volume[75593]: INFO dbcounter [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Registered counter for database cinder
Nov 07 02:24:54 devstack cinder-volume[75593]: DEBUG oslo_db.sqlalchemy.engines [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75593) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:24:54 devstack cinder-volume[75593]: DEBUG dbcounter [-] [75593] Writer thread running {{(pid=75593) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 07 02:24:54 devstack cinder-volume[75593]: INFO cinder.rpc [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 07 02:24:54 devstack cinder-volume[75593]: INFO cinder.rpc [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 07 02:24:54 devstack cinder-volume[75593]: DEBUG oslo_db.sqlalchemy.engines [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75593) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:24:54 devstack cinder-volume[75593]: INFO cinder.volume.manager [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Determined volume DB was empty at startup.
Nov 07 02:24:54 devstack cinder-volume[75593]: DEBUG cinder.volume.manager [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75593) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 07 02:24:54 devstack cinder-volume[75593]: INFO cinder.volume.manager [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 07 02:24:54 devstack cinder-volume[75593]: WARNING stevedore.named [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 07 02:24:54 devstack cinder-volume[75593]: WARNING castellan.key_manager [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 07 02:24:54 devstack cinder-volume[75593]: WARNING cinder.keymgr.conf_key_mgr [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 07 02:24:54 devstack cinder-volume[75593]: DEBUG cinder.volume.drivers.lvm [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75593) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Nov 07 02:24:54 devstack cinder-volume[75593]: DEBUG oslo_concurrency.processutils [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75593) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_concurrency.processutils [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] CMD "cinder-rtstool verify" returned: 0 in 0.420s {{(pid=75593) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_db.sqlalchemy.engines [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75593) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:24:55 devstack cinder-volume[75593]: INFO cinder.rpc [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Nov 07 02:24:55 devstack cinder-volume[75593]: INFO cinder.rpc [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Nov 07 02:24:55 devstack cinder-volume[75593]: WARNING stevedore.named [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 07 02:24:55 devstack cinder-volume[75593]: WARNING castellan.key_manager [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 07 02:24:55 devstack cinder-volume[75593]: INFO cinder.volume.manager [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_db.sqlalchemy.engines [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75593) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:24:55 devstack cinder-volume[75593]: INFO oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Starting 1 workers
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Started child 75755 {{(pid=75593) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Full set of CONF: {{(pid=75593) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] ******************************************************************************** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Configuration options gathered from: {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] ================================================================================ {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] allow_availability_zone_fallback = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] allow_compression_on_image_upload = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75755]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] allowed_direct_url_schemes     = [] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] api_rate_limit                 = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] auth_strategy                  = keystone {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] az_cache_duration              = 3600 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_availability_zone      = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_host                   = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_name                   = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_stats_polling_interval = 60 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backup_api_class               = cinder.backup.api.API {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backup_name_template           = backup-%s {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backup_use_same_host           = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backup_use_temp_snapshot       = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] chap_password                  = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] chap_username                  =  {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cinder_internal_tenant_project_id = 72b59c34f45f445faa2275c616b9f32a {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cinder_internal_tenant_user_id = 5a827a10a0414e30b4177ae503e31518 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cloned_volume_same_az          = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cluster                        = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] compression_format             = gzip {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] config_dir                     = [] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] config_source                  = [] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] control_exchange               = openstack {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] debug                          = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] default_availability_zone      = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] default_group_type             = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] default_volume_type            = lvmdriver-1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] disk_geometry                  = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] driver_client_cert             = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] driver_client_cert_key         = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] driver_data_namespace          = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] driver_ssl_cert_path           = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] driver_ssl_cert_verify         = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] driver_use_ssl                 = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] enable_force_upload            = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] enable_new_services            = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] enable_unsupported_driver      = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] enforce_multipath_for_image_xfer = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] filter_function                = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] glance_api_insecure            = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] glance_api_servers             = ['http://192.168.122.56/image'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] glance_api_ssl_compression     = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] glance_ca_certificates_file    = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] glance_certfile                = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] glance_keyfile                 = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] glance_num_retries             = 3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] glance_request_timeout         = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] goodness_function              = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] graceful_shutdown_timeout      = 5 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] group_api_class                = cinder.group.api.API {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] host                           = devstack {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] image_compress_on_upload       = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] image_conversion_address_space_limit = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] image_conversion_cpu_limit     = 60 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] image_conversion_disable       = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] image_introspection_address_space_limit = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] image_introspection_cpu_limit  = 60 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] image_upload_use_cinder_backend = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] image_upload_use_internal_tenant = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] image_volume_cache_enabled     = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] image_volume_cache_max_count   = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] image_volume_cache_max_size_gb = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] init_host_max_objects_retrieval = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] iscsi_target_flags             =  {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] iscsi_write_cache              = on {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] iser_helper                    = tgtadm {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] iser_ip_address                = 192.168.122.56 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] iser_port                      = 3260 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] log_color                      = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] log_config_append              = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75755]: INFO cinder.volume.manager [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Starting volume driver LVMVolumeDriver (3.0.0)
Nov 07 02:24:55 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] log_dir                        = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] log_file                       = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] log_options                    = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] log_rotate_interval            = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] log_rotate_interval_type       = days {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] log_rotation_type              = none {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] max_age                        = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] max_logfile_count              = 30 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] max_logfile_size_mb            = 200 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] max_over_subscription_ratio    = 20.0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] message_reap_interval          = 86400 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] message_ttl                    = 2592000 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] migration_create_volume_timeout_secs = 300 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] monkey_patch                   = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] monkey_patch_modules           = [] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] my_ip                          = 192.168.122.56 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] no_snapshot_gb_quota           = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] num_iser_scan_tries            = 3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] num_shell_tries                = 3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] num_volume_device_scan_tries   = 3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] nvmeof_conn_info_version       = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] nvmet_ns_id                    = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] nvmet_port_id                  = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] osapi_max_limit                = 1000 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] osapi_volume_ext_list          = [] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] osapi_volume_listen_port       = 8776 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] osapi_volume_use_ssl           = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] osapi_volume_workers           = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] per_volume_size_limit          = -1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] periodic_fuzzy_delay           = 60 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] periodic_interval              = 60 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] public_endpoint                = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] publish_errors                 = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] quota_backup_gigabytes         = 1000 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] quota_backups                  = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] quota_gigabytes                = 1000 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] quota_groups                   = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] quota_snapshots                = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] quota_volumes                  = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] rate_limit_burst               = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] rate_limit_except_level        = CRITICAL {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] rate_limit_interval            = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] reinit_driver_count            = 3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] replication_device             = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] report_discard_supported       = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] report_interval                = 120 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] reservation_clean_interval     = 86400 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] reservation_expire             = 86400 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] reserved_image_namespaces      = [] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] reserved_percentage            = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] rpc_response_timeout           = 120 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] run_external_periodic_tasks    = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] scst_target_driver             = iscsi {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] scst_target_iqn_name           = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] service_down_time              = 720 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] shell_completion               = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] snapshot_name_template         = snapshot-%s {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] snapshot_same_host             = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] split_loggers                  = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] state_path                     = /opt/stack/data/cinder {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] storage_availability_zone      = nova {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] storage_protocol               = iSCSI {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] syslog_log_facility            = LOG_USER {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] target_helper                  = lioadm {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.055s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] target_ip_address              = 192.168.122.56 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] target_port                    = 3260 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] target_protocol                = iscsi {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] target_secondary_ip_addresses  = [] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] trace_flags                    = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] transport_url                  = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] until_refresh                  = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] use_chap_auth                  = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] use_default_quota_class        = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] use_journal                    = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] use_json                       = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] use_multipath_for_image_xfer   = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] use_stderr                     = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] use_syslog                     = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] verify_glance_signatures       = enabled {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] volume_api_class               = cinder.volume.api.API {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] volume_backend_name            = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] volume_clear                   = zero {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] volume_clear_ionice            = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] volume_clear_size              = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] volume_copy_bps_limit          = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] volume_dd_blocksize            = 1M {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] volume_name_template           = volume-%s {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] volume_service_inithost_offload = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] volume_usage_audit_period      = month {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] zoning_mode                    = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_concurrency.disable_process_locking = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.auth_section = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.auth_type   = password {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.auth_version = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.cache       = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.certfile    = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.include_service_catalog = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.insecure    = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.interface   = public {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.keyfile     = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.memcache_password = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.memcache_username = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.region_name = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.service_type = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.56/identity {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.backend                  = dogpile.cache.null {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.backend_argument         = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.backend_expiration_time  = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.config_prefix            = cache.oslo {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.debug_cache_backend      = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.enable_retry_client      = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.enable_socket_keepalive  = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.enabled                  = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.expiration_time          = 600 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.hashclient_retry_attempts = 2 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.memcache_dead_retry      = 300 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.memcache_sasl_enabled    = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.password                 = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.proxies                  = [] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.058s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.redis_db                 = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.redis_server             = localhost:6379 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.retry_attempts           = 2 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.retry_delay              = 0.0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.socket_keepalive_count   = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.socket_keepalive_idle    = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.socket_keepalive_interval = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.socket_timeout           = 1.0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.tls_allowed_ciphers      = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.tls_cafile               = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.tls_certfile             = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.tls_enabled              = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.tls_keyfile              = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cache.username                 = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] coordination.backend_url       = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] database.asyncio_connection    = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] database.asyncio_slave_connection = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] database.backend               = sqlalchemy {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] database.connection            = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] database.connection_debug      = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] database.connection_parameters =  {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] database.connection_recycle_time = 3600 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] database.connection_trace      = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] database.db_inc_retry_interval = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] database.db_max_retries        = 20 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] database.db_max_retry_interval = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] database.db_retry_interval     = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] database.max_overflow          = 50 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] database.max_pool_size         = 5 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] database.max_retries           = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] database.mysql_wsrep_sync_wait = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] database.pool_timeout          = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] database.retry_interval        = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] database.slave_connection      = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] database.sqlite_synchronous    = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] database.synchronous_reader    = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] database.use_db_reconnect      = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_tracing.insecure = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] profiler.connection_string     = messaging:// {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] profiler.enabled               = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] profiler.es_doc_type           = notification {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] profiler.es_scroll_size        = 10000 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] profiler.es_scroll_time        = 2m {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] profiler.filter_error_trace    = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] profiler.hmac_keys             = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] profiler.sentinel_service_name = mymaster {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] profiler.socket_timeout        = 0.1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] profiler.trace_requests        = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] profiler.trace_sqlalchemy      = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] profiler_jaeger.process_tags   = {} {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] profiler_jaeger.service_name_prefix = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] profiler_otlp.service_name_prefix = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_policy.enforce_new_defaults = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_policy.policy_default_rule = default {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] privsep_osbrick.group          = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] privsep_osbrick.helper_command = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] privsep_osbrick.user           = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cinder_sys_admin.group         = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cinder_sys_admin.helper_command = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] cinder_sys_admin.user          = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] service_user.auth_section      = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] service_user.auth_type         = password {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] service_user.cafile            = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] service_user.certfile          = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] service_user.collect_timing    = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] service_user.insecure          = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] service_user.keyfile           = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] service_user.send_service_user_token = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] service_user.split_loggers     = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] service_user.timeout           = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] service_user.tls_ciphers       = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] service_user.tls_min_version   = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] glance.auth_section            = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] glance.auth_type               = password {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] glance.certfile                = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] glance.collect_timing          = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] glance.insecure                = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] glance.keyfile                 = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] glance.region_name             = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] glance.split_loggers           = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] glance.timeout                 = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] glance.tls_ciphers             = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] glance.tls_min_version         = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.backend_availability_zone = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.chap_password = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.chap_username =  {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.disk_geometry = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.driver_client_cert = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.driver_client_cert_key = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.driver_data_namespace = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.driver_use_ssl = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.extra_capabilities = {} {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.filter_function = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.goodness_function = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.iscsi_target_flags =  {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.iscsi_write_cache = on {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.iser_ip_address = 192.168.122.56 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.iser_port     = 3260 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.lvm_share_target = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.072s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.lvm_type      = auto {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.num_shell_tries = 3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.replication_device = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.report_discard_supported = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.reserved_percentage = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.target_helper = tgtadm {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.target_ip_address = 192.168.122.56 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.target_port   = 3260 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.target_protocol = iscsi {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.trace_flags   = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.unique_fqdn_network = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.use_chap_auth = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.volume_backend_name = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.volume_clear  = zero {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.volume_clear_ionice = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.volume_clear_size = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_reports.file_event_handler = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_reports.log_dir           = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.backend_host       = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.chap_password      = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.chap_username      = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.disk_geometry      = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.driver_client_cert = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.extra_capabilities = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.filter_function    = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.goodness_function  = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack sudo[75764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack sudo[75764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.iser_helper        = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.iser_port          = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.lvm_type           = auto {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.replication_device = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.report_discard_supported = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.reserved_percentage = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.scst_target_driver = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.storage_protocol   = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.target_ip_address  = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.target_port        = 3260 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.trace_flags        = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.volume_clear       = zero {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] lvmdriver-1.volumes_dir        = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_notifications.driver = [] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_notifications.retry = -1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] key_manager.fixed_key          = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican.barbican_api_version  = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican.barbican_endpoint     = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican.barbican_endpoint_type = public {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican.barbican_region_name  = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican.cafile                = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican.certfile              = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican.collect_timing        = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican.insecure              = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican.keyfile               = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican.number_of_retries     = 60 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican.retry_delay           = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican.send_service_user_token = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican.split_loggers         = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican.timeout               = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican.tls_ciphers           = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican.tls_min_version       = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican.verify_ssl            = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican.verify_ssl_path       = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican_service_user.auth_section = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican_service_user.auth_type = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican_service_user.cafile   = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican_service_user.certfile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican_service_user.collect_timing = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican_service_user.insecure = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican_service_user.keyfile  = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican_service_user.split_loggers = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican_service_user.timeout  = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican_service_user.tls_ciphers = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] barbican_service_user.tls_min_version = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] vault.approle_role_id          = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] vault.approle_secret_id        = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] vault.auth_method              = approle {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] vault.auth_path                = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] vault.kv_mountpoint            = secret {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] vault.kv_path                  = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] vault.kv_version               = 2 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] vault.namespace                = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] vault.root_token_id            = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] vault.ssl_ca_crt_file          = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] vault.timeout                  = 60.0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] vault.token_file               = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] vault.token_role               = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] vault.use_ssl                  = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:24:55 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] ******************************************************************************** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 07 02:24:56 devstack sudo[75764]: pam_unix(sudo:session): session closed for user root
Nov 07 02:24:56 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.341s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:24:56 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:24:56 devstack sudo[75916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:24:56 devstack sudo[75916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:24:56 devstack sudo[75916]: pam_unix(sudo:session): session closed for user root
Nov 07 02:24:56 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.273s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:24:56 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:24:56 devstack cinder-volume[75755]: INFO cinder.brick.local_dev.lvm [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Nov 07 02:24:56 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:24:56 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:24:56 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:24:56 devstack sudo[76013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 07 02:24:56 devstack sudo[76013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:24:56 devstack sudo[76013]: pam_unix(sudo:session): session closed for user root
Nov 07 02:24:56 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:24:56 devstack cinder-volume[75755]: DEBUG cinder.brick.local_dev.lvm [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75755) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Nov 07 02:24:56 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:24:56 devstack sudo[76101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:24:56 devstack sudo[76101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:24:57 devstack sudo[76101]: pam_unix(sudo:session): session closed for user root
Nov 07 02:24:57 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.637s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:24:57 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:24:57 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:24:57 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:24:57 devstack sudo[76292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:24:57 devstack sudo[76292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:24:57 devstack sudo[76292]: pam_unix(sudo:session): session closed for user root
Nov 07 02:24:57 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.330s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:24:57 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:24:57 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:24:57 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:24:57 devstack sudo[76374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Nov 07 02:24:57 devstack sudo[76374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:24:58 devstack sudo[76374]: pam_unix(sudo:session): session closed for user root
Nov 07 02:24:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.269s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:24:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:24:58 devstack sudo[76393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 07 02:24:58 devstack sudo[76393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:24:58 devstack sudo[76393]: pam_unix(sudo:session): session closed for user root
Nov 07 02:24:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.331s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:24:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:24:58 devstack sudo[76462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 07 02:24:58 devstack sudo[76462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:24:58 devstack sudo[76462]: pam_unix(sudo:session): session closed for user root
Nov 07 02:24:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:24:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:24:58 devstack sudo[76471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:24:58 devstack sudo[76471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:24:59 devstack sudo[76471]: pam_unix(sudo:session): session closed for user root
Nov 07 02:24:59 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.335s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:24:59 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:24:59 devstack sudo[76554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:24:59 devstack sudo[76554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:24:59 devstack sudo[76554]: pam_unix(sudo:session): session closed for user root
Nov 07 02:24:59 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.306s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:24:59 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:24:59 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:24:59 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:24:59 devstack sudo[76558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:24:59 devstack sudo[76558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:24:59 devstack sudo[76558]: pam_unix(sudo:session): session closed for user root
Nov 07 02:24:59 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:24:59 devstack cinder-volume[75755]: INFO cinder.volume.drivers.lvm [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Enabling LVM thin provisioning by default because a thin pool exists.
Nov 07 02:24:59 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:24:59 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:24:59 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:24:59 devstack sudo[76568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:24:59 devstack sudo[76568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:24:59 devstack sudo[76568]: pam_unix(sudo:session): session closed for user root
Nov 07 02:24:59 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:24:59 devstack cinder-volume[75755]: DEBUG cinder.volume.drivers.lvm [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Updating volume stats {{(pid=75755) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 07 02:24:59 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:24:59 devstack sudo[76571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 07 02:24:59 devstack sudo[76571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:00 devstack sudo[76571]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:00 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:00 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:00 devstack sudo[76574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:25:00 devstack sudo[76574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:00 devstack sudo[76574]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:00 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:00 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:00 devstack sudo[76577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:25:00 devstack sudo[76577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:00 devstack sudo[76577]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:00 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:00 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:00 devstack sudo[76580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:25:00 devstack sudo[76580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:01 devstack sudo[76580]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:01 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:01 devstack cinder-volume[75755]: INFO cinder.volume.driver [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Driver hasn't implemented _init_vendor_properties()
Nov 07 02:25:01 devstack cinder-volume[75755]: DEBUG cinder.volume.driver [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75755) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 07 02:25:01 devstack cinder-volume[75755]: DEBUG oslo_db.sqlalchemy.engines [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75755) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:25:01 devstack cinder-volume[75755]: DEBUG dbcounter [-] [75755] Writer thread running {{(pid=75755) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 07 02:25:01 devstack cinder-volume[75755]: DEBUG cinder.db.api [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Building query based on filter {{(pid=75755) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 07 02:25:01 devstack cinder-volume[75755]: DEBUG cinder.image.image_utils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75755) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 07 02:25:01 devstack cinder-volume[75755]: INFO cinder.keymgr.migration [None req-28a8ecc4-7e24-47f8-b517-dcc12f9a4365 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 07 02:25:01 devstack cinder-volume[75755]: DEBUG cinder.volume.drivers.lvm [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Updating volume stats {{(pid=75755) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 07 02:25:01 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:01 devstack sudo[76585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 07 02:25:01 devstack sudo[76585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:01 devstack sudo[76585]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:01 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:01 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:01 devstack sudo[76588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:25:01 devstack sudo[76588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:01 devstack sudo[76588]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:01 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:01 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:01 devstack sudo[76594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:25:01 devstack sudo[76594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:02 devstack sudo[76594]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:02 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.292s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:02 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:02 devstack sudo[76597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:25:02 devstack sudo[76597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:02 devstack sudo[76597]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:02 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:02 devstack cinder-volume[75755]: DEBUG cinder.manager [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Notifying Schedulers of capabilities ... {{(pid=75755) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:25:02 devstack cinder-volume[75755]: INFO cinder.volume.manager [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Driver initialization completed successfully.
Nov 07 02:25:02 devstack cinder-volume[75755]: INFO cinder.manager [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Initiating service 2 cleanup
Nov 07 02:25:02 devstack cinder-volume[75755]: INFO cinder.manager [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Service 2 cleanup completed.
Nov 07 02:25:02 devstack cinder-volume[75755]: DEBUG cinder.service [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Creating RPC server for service cinder-volume {{(pid=75755) start /opt/stack/cinder/cinder/service.py:231}}
Nov 07 02:25:02 devstack cinder-volume[75755]: DEBUG cinder.service [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75755) start /opt/stack/cinder/cinder/service.py:237}}
Nov 07 02:25:02 devstack cinder-volume[75755]: INFO cinder.volume.manager [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Nov 07 02:25:02 devstack cinder-volume[75755]: DEBUG cinder.volume.drivers.lvm [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Updating volume stats {{(pid=75755) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 07 02:25:02 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:02 devstack sudo[76603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 07 02:25:02 devstack sudo[76603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:02 devstack sudo[76603]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:02 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:02 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:02 devstack sudo[76606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:25:02 devstack sudo[76606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:03 devstack sudo[76606]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:03 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:03 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:03 devstack sudo[76612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:25:03 devstack sudo[76612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:03 devstack sudo[76612]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:03 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.238s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:03 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:03 devstack sudo[76615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:25:03 devstack sudo[76615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:03 devstack sudo[76615]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:03 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.233s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:03 devstack cinder-volume[75755]: INFO cinder.volume.manager [None req-8d935551-b967-41c9-9105-d6f35f786adb None None] Driver post RPC initialization completed successfully.
Nov 07 02:25:05 devstack cinder-volume[75593]: DEBUG dbcounter [-] [75593] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75593) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:25:12 devstack cinder-volume[75755]: DEBUG dbcounter [-] [75755] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75755) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:25:13 devstack cinder-volume[75755]: DEBUG dbcounter [-] [75755] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=75755) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:25:57 devstack cinder-volume[75755]: DEBUG oslo_service.periodic_task [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75755) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:25:57 devstack cinder-volume[75755]: DEBUG cinder.volume.drivers.lvm [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Updating volume stats {{(pid=75755) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 07 02:25:57 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:57 devstack sudo[78954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 07 02:25:57 devstack sudo[78954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:57 devstack sudo[78954]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:57 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:57 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:57 devstack sudo[78957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:25:57 devstack sudo[78957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:58 devstack sudo[78957]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:58 devstack sudo[78960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:25:58 devstack sudo[78960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:58 devstack sudo[78960]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:25:58 devstack sudo[78963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:25:58 devstack sudo[78963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:25:58 devstack sudo[78963]: pam_unix(sudo:session): session closed for user root
Nov 07 02:25:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:25:58 devstack cinder-volume[75755]: DEBUG cinder.manager [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Notifying Schedulers of capabilities ... {{(pid=75755) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:25:58 devstack cinder-volume[75755]: DEBUG oslo_service.periodic_task [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Running periodic task VolumeManager._thread_info {{(pid=75755) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:25:58 devstack cinder-volume[75755]: DEBUG cinder.volume.manager [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] thread count: 6 {{(pid=75755) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:25:58 devstack cinder-volume[75755]: DEBUG cinder.volume.manager [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] thread info: [<_MainThread(MainThread, started 134082994540672)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134082892904256)>, <Thread(Thread-3 (stat_writer), started daemon 134082879811712)>, <Thread(Rabbit-heartbeat, started daemon 134082879800576)>, <Thread(Thread-5 (_runner), started daemon 134082879181056)>, <Thread(Thread-7 (_runner), started daemon 134082877252032)>] {{(pid=75755) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:26:57 devstack cinder-volume[75755]: DEBUG oslo_service.periodic_task [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75755) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:26:57 devstack cinder-volume[75755]: DEBUG cinder.volume.drivers.lvm [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Updating volume stats {{(pid=75755) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 07 02:26:57 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:26:57 devstack sudo[82259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 07 02:26:57 devstack sudo[82259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:26:57 devstack sudo[82259]: pam_unix(sudo:session): session closed for user root
Nov 07 02:26:57 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:26:57 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:26:57 devstack sudo[82301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:26:57 devstack sudo[82301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:26:58 devstack sudo[82301]: pam_unix(sudo:session): session closed for user root
Nov 07 02:26:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:26:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:26:58 devstack sudo[82306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:26:58 devstack sudo[82306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:26:58 devstack sudo[82306]: pam_unix(sudo:session): session closed for user root
Nov 07 02:26:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:26:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:26:58 devstack sudo[82313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:26:58 devstack sudo[82313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:26:58 devstack sudo[82313]: pam_unix(sudo:session): session closed for user root
Nov 07 02:26:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.236s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:26:58 devstack cinder-volume[75755]: DEBUG cinder.manager [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Notifying Schedulers of capabilities ... {{(pid=75755) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:27:13 devstack cinder-volume[75755]: DEBUG dbcounter [-] [75755] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75755) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:27:57 devstack cinder-volume[75755]: DEBUG oslo_service.periodic_task [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75755) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:27:57 devstack cinder-volume[75755]: DEBUG cinder.volume.drivers.lvm [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Updating volume stats {{(pid=75755) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 07 02:27:57 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:27:57 devstack sudo[84456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 07 02:27:57 devstack sudo[84456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:27:57 devstack sudo[84456]: pam_unix(sudo:session): session closed for user root
Nov 07 02:27:57 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:27:57 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:27:57 devstack sudo[84472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:27:57 devstack sudo[84472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:27:58 devstack sudo[84472]: pam_unix(sudo:session): session closed for user root
Nov 07 02:27:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:27:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:27:58 devstack sudo[84484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:27:58 devstack sudo[84484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:27:58 devstack sudo[84484]: pam_unix(sudo:session): session closed for user root
Nov 07 02:27:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.238s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:27:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:27:58 devstack sudo[84487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:27:58 devstack sudo[84487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:27:58 devstack sudo[84487]: pam_unix(sudo:session): session closed for user root
Nov 07 02:27:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:27:58 devstack cinder-volume[75755]: DEBUG cinder.manager [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Notifying Schedulers of capabilities ... {{(pid=75755) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:27:58 devstack cinder-volume[75755]: DEBUG oslo_service.periodic_task [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Running periodic task VolumeManager._thread_info {{(pid=75755) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:27:58 devstack cinder-volume[75755]: DEBUG cinder.volume.manager [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] thread count: 6 {{(pid=75755) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:27:58 devstack cinder-volume[75755]: DEBUG cinder.volume.manager [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] thread info: [<_MainThread(MainThread, started 134082994540672)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134082892904256)>, <Thread(Thread-3 (stat_writer), started daemon 134082879811712)>, <Thread(Rabbit-heartbeat, started daemon 134082879800576)>, <Thread(Thread-5 (_runner), started daemon 134082879181056)>, <Thread(Thread-7 (_runner), started daemon 134082877252032)>] {{(pid=75755) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:28:57 devstack cinder-volume[75755]: DEBUG oslo_service.periodic_task [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75755) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:28:57 devstack cinder-volume[75755]: DEBUG cinder.volume.drivers.lvm [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Updating volume stats {{(pid=75755) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 07 02:28:57 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:28:57 devstack sudo[85750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 07 02:28:57 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:28:57 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root
Nov 07 02:28:57 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:28:57 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:28:57 devstack sudo[85776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:28:57 devstack sudo[85776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:28:58 devstack sudo[85776]: pam_unix(sudo:session): session closed for user root
Nov 07 02:28:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:28:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:28:58 devstack sudo[85779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 07 02:28:58 devstack sudo[85779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:28:58 devstack sudo[85779]: pam_unix(sudo:session): session closed for user root
Nov 07 02:28:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:28:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:28:58 devstack sudo[85785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 07 02:28:58 devstack sudo[85785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:28:58 devstack sudo[85785]: pam_unix(sudo:session): session closed for user root
Nov 07 02:28:58 devstack cinder-volume[75755]: DEBUG oslo_concurrency.processutils [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75755) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:28:58 devstack cinder-volume[75755]: DEBUG cinder.manager [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Notifying Schedulers of capabilities ... {{(pid=75755) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:28:58 devstack cinder-volume[75755]: DEBUG oslo_service.periodic_task [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] Running periodic task VolumeManager._thread_info {{(pid=75755) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:28:58 devstack cinder-volume[75755]: DEBUG cinder.volume.manager [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] thread count: 6 {{(pid=75755) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:28:58 devstack cinder-volume[75755]: DEBUG cinder.volume.manager [None req-1aea01ff-3d76-4939-a25a-617c93b12c80 None None] thread info: [<_MainThread(MainThread, started 134082994540672)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134082892904256)>, <Thread(Thread-3 (stat_writer), started daemon 134082879811712)>, <Thread(Rabbit-heartbeat, started daemon 134082879800576)>, <Thread(Thread-5 (_runner), started daemon 134082879181056)>, <Thread(Thread-7 (_runner), started daemon 134082877252032)>] {{(pid=75755) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:29:13 devstack cinder-volume[75755]: DEBUG dbcounter [-] [75755] Writing DB stats cinder:SELECT=1 {{(pid=75755) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:29:13 devstack cinder-volume[75755]: DEBUG dbcounter [-] [75755] Writing DB stats cinder:UPDATE=1 {{(pid=75755) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:29:13 devstack cinder-volume[75593]: INFO oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Caught SIGTERM, stopping children
Nov 07 02:29:13 devstack cinder-volume[75593]: DEBUG oslo_concurrency.lockutils [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Acquiring lock "singleton_lock" {{(pid=75593) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 07 02:29:13 devstack cinder-volume[75593]: DEBUG oslo_concurrency.lockutils [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Acquired lock "singleton_lock" {{(pid=75593) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 07 02:29:13 devstack cinder-volume[75593]: DEBUG oslo_concurrency.lockutils [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Releasing lock "singleton_lock" {{(pid=75593) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 07 02:29:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Stop services. {{(pid=75593) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 07 02:29:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Killing children. {{(pid=75593) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 07 02:29:13 devstack cinder-volume[75593]: INFO oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Waiting on 1 children to exit
Nov 07 02:29:17 devstack cinder-volume[75755]: DEBUG oslo_concurrency.lockutils [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Acquiring lock "singleton_lock" {{(pid=75755) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 07 02:29:17 devstack cinder-volume[75755]: DEBUG oslo_concurrency.lockutils [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Acquired lock "singleton_lock" {{(pid=75755) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 07 02:29:17 devstack cinder-volume[75755]: DEBUG oslo_concurrency.lockutils [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Releasing lock "singleton_lock" {{(pid=75755) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 07 02:29:17 devstack cinder-volume[75755]: WARNING amqp [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 07 02:29:17 devstack cinder-volume[75755]: WARNING amqp [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 07 02:29:17 devstack cinder-volume[75593]: INFO oslo_service.backend._eventlet.service [None req-6473a008-c27d-467b-ba5a-f7bae769bb15 None None] Child 75755 exited with status 0
Nov 07 02:29:17 devstack cinder-volume[86245]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 07 02:29:17 devstack cinder-volume[86245]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 07 02:29:17 devstack cinder-volume[86245]: we strongly recommend against using it for new projects.
Nov 07 02:29:17 devstack cinder-volume[86245]: If you are already using Eventlet, we recommend migrating to a different
Nov 07 02:29:17 devstack cinder-volume[86245]: framework.  For more detail see
Nov 07 02:29:17 devstack cinder-volume[86245]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 07 02:29:17 devstack cinder-volume[86245]:   import eventlet  # noqa
Nov 07 02:29:20 devstack cinder-volume[86245]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 07 02:29:20 devstack cinder-volume[86245]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 07 02:29:20 devstack cinder-volume[86245]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 07 02:29:20 devstack cinder-volume[86245]: INFO dbcounter [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Registered counter for database cinder
Nov 07 02:29:20 devstack cinder-volume[86245]: DEBUG oslo_db.sqlalchemy.engines [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86245) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG dbcounter [-] [86245] Writer thread running {{(pid=86245) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 07 02:29:21 devstack cinder-volume[86245]: INFO cinder.rpc [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 07 02:29:21 devstack cinder-volume[86245]: INFO cinder.rpc [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_db.sqlalchemy.engines [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86245) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:29:21 devstack cinder-volume[86245]: INFO cinder.volume.manager [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Determined volume DB was empty at startup.
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG cinder.volume.manager [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86245) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 07 02:29:21 devstack cinder-volume[86245]: INFO cinder.volume.manager [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 07 02:29:21 devstack cinder-volume[86245]: WARNING stevedore.named [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 07 02:29:21 devstack cinder-volume[86245]: WARNING castellan.key_manager [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 07 02:29:21 devstack cinder-volume[86245]: WARNING cinder.keymgr.conf_key_mgr [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 07 02:29:21 devstack cinder-volume[86245]: INFO cinder.volume.manager [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_db.sqlalchemy.engines [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86245) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:29:21 devstack cinder-volume[86245]: INFO oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Starting 1 workers
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Started child 86462 {{(pid=86245) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Full set of CONF: {{(pid=86245) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] ******************************************************************************** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Configuration options gathered from: {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] ================================================================================ {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] allow_availability_zone_fallback = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] allow_compression_on_image_upload = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] allowed_direct_url_schemes     = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] api_rate_limit                 = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86462]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] auth_strategy                  = keystone {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_availability_zone      = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_host                   = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_name                   = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_stats_polling_interval = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backup_api_class               = cinder.backup.api.API {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backup_name_template           = backup-%s {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backup_use_same_host           = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backup_use_temp_snapshot       = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] chap_password                  = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] chap_username                  =  {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cinder_internal_tenant_project_id = 72b59c34f45f445faa2275c616b9f32a {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cinder_internal_tenant_user_id = 5a827a10a0414e30b4177ae503e31518 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cluster                        = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] compression_format             = gzip {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] compute_api_class              = cinder.compute.nova.API {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] config_dir                     = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] config_source                  = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] control_exchange               = openstack {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] debug                          = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] default_availability_zone      = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] default_group_type             = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] default_volume_type            = QuobyteHD {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] disk_geometry                  = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] driver_client_cert             = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] driver_client_cert_key         = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] driver_data_namespace          = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] driver_ssl_cert_path           = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] driver_ssl_cert_verify         = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] driver_use_ssl                 = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] enable_new_services            = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] enable_unsupported_driver      = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] enabled_backends               = ['QuobyteHD'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] enforce_multipath_for_image_xfer = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] filter_function                = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] glance_api_insecure            = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] glance_api_servers             = ['http://192.168.122.56/image'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] glance_api_ssl_compression     = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] glance_ca_certificates_file    = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] glance_catalog_info            = image:glance:publicURL {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] glance_certfile                = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] glance_keyfile                 = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] glance_num_retries             = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] glance_request_timeout         = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] goodness_function              = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] graceful_shutdown_timeout      = 5 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] group_api_class                = cinder.group.api.API {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] host                           = devstack {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] image_compress_on_upload       = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] image_conversion_address_space_limit = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] image_conversion_cpu_limit     = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] image_conversion_disable       = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] image_introspection_address_space_limit = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] image_introspection_cpu_limit  = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] image_upload_use_cinder_backend = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] image_upload_use_internal_tenant = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86462]: INFO cinder.volume.manager [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 07 02:29:21 devstack cinder-volume[86462]: DEBUG cinder.volume.drivers.remotefs [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86462) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] image_volume_cache_enabled     = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] image_volume_cache_max_count   = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] image_volume_cache_max_size_gb = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] init_host_max_objects_retrieval = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] instance_format                = [instance: %(uuid)s]  {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] iscsi_target_flags             =  {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] iscsi_write_cache              = on {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] iser_helper                    = tgtadm {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] iser_ip_address                = 192.168.122.56 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] iser_port                      = 3260 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] log_color                      = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] log_config_append              = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] log_dir                        = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] log_file                       = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] log_options                    = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] log_rotate_interval            = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] log_rotate_interval_type       = days {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] log_rotation_type              = none {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] max_age                        = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] max_logfile_count              = 30 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] max_logfile_size_mb            = 200 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] max_over_subscription_ratio    = 20.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] message_reap_interval          = 86400 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] message_ttl                    = 2592000 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] migration_create_volume_timeout_secs = 300 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] monkey_patch                   = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] monkey_patch_modules           = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] my_ip                          = 192.168.122.56 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] no_snapshot_gb_quota           = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] num_iser_scan_tries            = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] num_shell_tries                = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] num_volume_device_scan_tries   = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] nvmeof_conn_info_version       = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] nvmet_ns_id                    = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] nvmet_port_id                  = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] osapi_max_limit                = 1000 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] osapi_volume_ext_list          = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] osapi_volume_listen_port       = 8776 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] osapi_volume_use_ssl           = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] osapi_volume_workers           = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] per_volume_size_limit          = -1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] periodic_fuzzy_delay           = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] periodic_interval              = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] public_endpoint                = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] publish_errors                 = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] quota_backup_gigabytes         = 1000 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] quota_backups                  = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] quota_gigabytes                = 1000 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] quota_groups                   = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] quota_snapshots                = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] quota_volumes                  = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] rate_limit_burst               = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] rate_limit_except_level        = CRITICAL {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] rate_limit_interval            = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] reinit_driver_count            = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] replication_device             = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] report_discard_supported       = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] report_interval                = 120 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] reservation_clean_interval     = 86400 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] reservation_expire             = 86400 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] reserved_image_namespaces      = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] reserved_percentage            = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] rpc_response_timeout           = 120 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] run_external_periodic_tasks    = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] scst_target_driver             = iscsi {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] scst_target_iqn_name           = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] service_down_time              = 720 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] shell_completion               = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] snapshot_name_template         = snapshot-%s {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] split_loggers                  = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] state_path                     = /opt/stack/data/cinder {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] storage_availability_zone      = nova {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] storage_protocol               = iSCSI {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] syslog_log_facility            = LOG_USER {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] target_helper                  = lioadm {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] target_ip_address              = 192.168.122.56 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] target_port                    = 3260 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] target_protocol                = iscsi {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] target_secondary_ip_addresses  = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] trace_flags                    = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] transport_url                  = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] until_refresh                  = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] use_chap_auth                  = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] use_default_quota_class        = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] use_journal                    = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] use_json                       = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] use_multipath_for_image_xfer   = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] use_stderr                     = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] use_syslog                     = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] verify_glance_signatures       = enabled {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] volume_api_class               = cinder.volume.api.API {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] volume_backend_name            = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] volume_clear                   = zero {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] volume_clear_ionice            = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] volume_clear_size              = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] volume_copy_bps_limit          = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] volume_dd_blocksize            = 1M {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] volume_name_template           = volume-%s {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] volume_service_inithost_offload = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] volume_usage_audit_period      = month {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] zoning_mode                    = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_concurrency.disable_process_locking = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.auth_section = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.auth_type   = password {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.auth_version = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.cache       = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.certfile    = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.delay_auth_decision = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.http_connect_timeout = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.include_service_catalog = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.insecure    = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.interface   = public {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.keyfile     = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.memcache_password = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.memcache_username = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.region_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.service_token_roles_required = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.service_type = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.token_cache_time = 300 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.56/identity {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.backend                  = dogpile.cache.null {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.backend_argument         = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.backend_expiration_time  = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.config_prefix            = cache.oslo {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.debug_cache_backend      = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.enable_retry_client      = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.enable_socket_keepalive  = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.enabled                  = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.expiration_time          = 600 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.hashclient_retry_attempts = 2 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.memcache_dead_retry      = 300 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.memcache_pool_maxsize    = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.memcache_sasl_enabled    = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.password                 = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.proxies                  = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.redis_db                 = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.redis_sentinel_service_name = mymaster {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.redis_server             = localhost:6379 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.retry_attempts           = 2 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.retry_delay              = 0.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.socket_keepalive_count   = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.socket_keepalive_idle    = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.socket_keepalive_interval = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.socket_timeout           = 1.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.tls_allowed_ciphers      = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.tls_cafile               = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.tls_certfile             = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.tls_enabled              = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.tls_keyfile              = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cache.username                 = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] coordination.backend_url       = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] database.asyncio_connection    = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] database.asyncio_slave_connection = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] database.backend               = sqlalchemy {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] database.connection            = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] database.connection_debug      = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] database.connection_parameters =  {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] database.connection_recycle_time = 3600 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] database.connection_trace      = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] database.db_inc_retry_interval = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] database.db_max_retries        = 20 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] database.db_max_retry_interval = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] database.db_retry_interval     = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] database.max_overflow          = 50 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] database.max_pool_size         = 5 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] database.max_retries           = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86462]: DEBUG cinder.volume.drivers.quobyte [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86462) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] database.mysql_wsrep_sync_wait = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] database.pool_timeout          = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] database.retry_interval        = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86462]: WARNING cinder.volume.drivers.quobyte [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] database.slave_connection      = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] database.sqlite_synchronous    = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] database.synchronous_reader    = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] database.use_db_reconnect      = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86462]: WARNING cinder.volume.drivers.quobyte [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_tracing.insecure = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86462]: DEBUG oslo_concurrency.processutils [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Running cmd (subprocess): mount.quobyte {{(pid=86462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] profiler.connection_string     = messaging:// {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] profiler.enabled               = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] profiler.es_doc_type           = notification {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] profiler.es_scroll_size        = 10000 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] profiler.es_scroll_time        = 2m {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] profiler.filter_error_trace    = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] profiler.hmac_keys             = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] profiler.sentinel_service_name = mymaster {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] profiler.socket_timeout        = 0.1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] profiler.trace_requests        = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] profiler.trace_sqlalchemy      = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] profiler_jaeger.process_tags   = {} {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] profiler_jaeger.service_name_prefix = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] profiler_otlp.service_name_prefix = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_policy.enforce_new_defaults = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_policy.policy_default_rule = default {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_policy.policy_file        = policy.yaml {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] privsep_osbrick.group          = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] privsep_osbrick.helper_command = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] privsep_osbrick.user           = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cinder_sys_admin.group         = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cinder_sys_admin.helper_command = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] cinder_sys_admin.user          = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] service_user.auth_section      = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] service_user.auth_type         = password {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] service_user.cafile            = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] service_user.certfile          = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] service_user.collect_timing    = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] service_user.insecure          = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] service_user.keyfile           = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] service_user.send_service_user_token = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] service_user.split_loggers     = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] service_user.timeout           = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] service_user.tls_ciphers       = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] service_user.tls_min_version   = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] glance.auth_section            = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] glance.auth_type               = password {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] glance.certfile                = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] glance.collect_timing          = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] glance.insecure                = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] glance.keyfile                 = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] glance.region_name             = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] glance.split_loggers           = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] glance.timeout                 = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] glance.tls_ciphers             = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] glance.tls_min_version         = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.backend_availability_zone = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.chap_password = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.chap_username =  {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.disk_geometry = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.driver_client_cert = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.driver_client_cert_key = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.driver_data_namespace = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.driver_use_ssl = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.enable_unsupported_driver = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.extra_capabilities = {} {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.filter_function = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.goodness_function = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.iscsi_target_flags =  {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.iscsi_write_cache = on {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.iser_helper   = tgtadm {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.iser_ip_address = 192.168.122.56 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.iser_port     = 3260 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.nas_host      =  {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.nas_login     = admin {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.nas_mount_options = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.nas_password  = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.nas_private_key =  {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.nas_share_path =  {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.num_shell_tries = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.nvmet_port_id = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.quobyte_client_cfg = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.quobyte_volume_url = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.replication_device = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.report_discard_supported = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.reserved_percentage = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.scst_target_driver = iscsi {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.scst_target_iqn_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.storage_protocol = iSCSI {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.target_helper = tgtadm {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.target_ip_address = 192.168.122.56 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.target_port   = 3260 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.target_protocol = iscsi {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.trace_flags   = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.unique_fqdn_network = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.use_chap_auth = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.volume_backend_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.volume_clear  = zero {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.volume_clear_ionice = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.volume_clear_size = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_reports.file_event_handler = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_reports.log_dir           = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.backend_availability_zone = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.backend_host         = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.chap_password        = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.chap_username        = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.chiscsi_conf         = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.disk_geometry        = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.driver_client_cert   = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.driver_client_cert_key = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.driver_data_namespace = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.driver_use_ssl       = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.extra_capabilities   = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.filter_function      = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.goodness_function    = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.iser_helper          = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.iser_ip_address      = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.iser_port            = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.iser_target_prefix   = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.nas_host             = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.nas_login            = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.nas_mount_options    = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.nas_password         = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.nas_private_key      = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.nas_share_path       = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.nas_ssh_port         = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.num_shell_tries      = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.nvmet_port_id        = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.replication_device   = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.report_discard_supported = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.reserved_percentage  = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.scst_target_driver   = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.storage_protocol     = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.target_helper        = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.target_ip_address    = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.target_port          = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.target_prefix        = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.target_protocol      = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.trace_flags          = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.use_chap_auth        = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.volume_clear         = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.volume_clear_size    = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] QuobyteHD.volumes_dir          = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.ssl      = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_notifications.driver = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_notifications.retry = -1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] oslo_messaging_notifications.transport_url = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] key_manager.fixed_key          = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican.barbican_api_version  = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican.barbican_endpoint     = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican.barbican_endpoint_type = public {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican.barbican_region_name  = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican.cafile                = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican.certfile              = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican.collect_timing        = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican.insecure              = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican.keyfile               = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican.number_of_retries     = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican.retry_delay           = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican.send_service_user_token = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican.split_loggers         = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican.timeout               = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican.tls_ciphers           = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican.tls_min_version       = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican.verify_ssl            = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican.verify_ssl_path       = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican_service_user.auth_section = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican_service_user.auth_type = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican_service_user.cafile   = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican_service_user.certfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican_service_user.collect_timing = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican_service_user.insecure = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican_service_user.keyfile  = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican_service_user.split_loggers = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican_service_user.timeout  = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican_service_user.tls_ciphers = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] barbican_service_user.tls_min_version = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] vault.approle_role_id          = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] vault.approle_secret_id        = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] vault.auth_method              = approle {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] vault.auth_path                = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] vault.kv_mountpoint            = secret {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] vault.kv_path                  = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] vault.kv_version               = 2 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] vault.namespace                = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] vault.root_token_id            = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] vault.ssl_ca_crt_file          = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] vault.timeout                  = 60.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] vault.token_file               = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] vault.token_role               = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] vault.use_ssl                  = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:21 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] ******************************************************************************** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 07 02:29:21 devstack quobyte-client[86466]: Reading configuration file: /etc/quobyte/client.cfg
Nov 07 02:29:21 devstack quobyte-client[86466]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 07 02:29:21 devstack cinder-volume[86462]: DEBUG oslo_concurrency.processutils [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] CMD "mount.quobyte" returned: 1 in 0.125s {{(pid=86462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:29:21 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86462) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:29:21 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86462) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:29:21 devstack cinder-volume[86462]: DEBUG cinder.volume.drivers.quobyte [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=86462) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:29:21 devstack cinder-volume[86462]: INFO cinder.volume.drivers.quobyte [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c ...
Nov 07 02:29:21 devstack cinder-volume[86462]: DEBUG oslo_concurrency.processutils [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 -c /etc/quobyte/client-cinder.cfg {{(pid=86462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:29:21 devstack sudo[86467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 -c /etc/quobyte/client-cinder.cfg
Nov 07 02:29:21 devstack sudo[86467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:29:22 devstack sudo[86467]: pam_unix(sudo:session): session closed for user root
Nov 07 02:29:22 devstack cinder-volume[86462]: DEBUG oslo_concurrency.processutils [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.485s {{(pid=86462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:29:22 devstack cinder-volume[86462]: INFO cinder.volume.drivers.quobyte [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c succeeded
Nov 07 02:29:22 devstack cinder-volume[86462]: DEBUG cinder.volume.drivers.quobyte [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=86462) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:29:22 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.502s {{(pid=86462) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:29:22 devstack cinder-volume[86462]: DEBUG oslo_concurrency.processutils [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=86462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:29:22 devstack sudo[86569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:29:22 devstack sudo[86569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:29:22 devstack sudo[86569]: pam_unix(sudo:session): session closed for user root
Nov 07 02:29:22 devstack cinder-volume[86462]: DEBUG oslo_concurrency.processutils [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.291s {{(pid=86462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:29:22 devstack cinder-volume[86462]: INFO cinder.volume.driver [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Driver hasn't implemented _init_vendor_properties()
Nov 07 02:29:22 devstack cinder-volume[86462]: DEBUG cinder.volume.driver [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7832832336426, 'free_capacity_gb': 1773.7832832336426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86462) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 07 02:29:22 devstack cinder-volume[86462]: DEBUG oslo_db.sqlalchemy.engines [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86462) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:29:22 devstack cinder-volume[86462]: DEBUG dbcounter [-] [86462] Writer thread running {{(pid=86462) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 07 02:29:22 devstack cinder-volume[86462]: DEBUG cinder.db.api [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Building query based on filter {{(pid=86462) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 07 02:29:22 devstack cinder-volume[86462]: DEBUG cinder.image.image_utils [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86462) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 07 02:29:22 devstack cinder-volume[86462]: INFO cinder.keymgr.migration [None req-00b4142c-9443-4c9f-9e6e-afd235f8838a None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 07 02:29:22 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86462) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:29:22 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86462) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:29:22 devstack cinder-volume[86462]: DEBUG cinder.volume.drivers.quobyte [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=86462) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:29:22 devstack cinder-volume[86462]: DEBUG cinder.volume.drivers.quobyte [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=86462) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:29:22 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86462) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:29:22 devstack cinder-volume[86462]: DEBUG oslo_concurrency.processutils [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=86462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:29:22 devstack sudo[86597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:29:22 devstack sudo[86597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:29:23 devstack sudo[86597]: pam_unix(sudo:session): session closed for user root
Nov 07 02:29:23 devstack cinder-volume[86462]: DEBUG oslo_concurrency.processutils [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.509s {{(pid=86462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:29:23 devstack cinder-volume[86462]: DEBUG cinder.manager [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Notifying Schedulers of capabilities ... {{(pid=86462) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:29:23 devstack cinder-volume[86462]: INFO cinder.volume.manager [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Driver initialization completed successfully.
Nov 07 02:29:23 devstack cinder-volume[86462]: INFO cinder.manager [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Initiating service 3 cleanup
Nov 07 02:29:23 devstack cinder-volume[86462]: INFO cinder.manager [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Service 3 cleanup completed.
Nov 07 02:29:23 devstack cinder-volume[86462]: DEBUG cinder.service [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Creating RPC server for service cinder-volume {{(pid=86462) start /opt/stack/cinder/cinder/service.py:231}}
Nov 07 02:29:23 devstack cinder-volume[86462]: DEBUG cinder.service [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86462) start /opt/stack/cinder/cinder/service.py:237}}
Nov 07 02:29:23 devstack cinder-volume[86462]: INFO cinder.volume.manager [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 07 02:29:23 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86462) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:29:23 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86462) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:29:23 devstack cinder-volume[86462]: DEBUG cinder.volume.drivers.quobyte [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=86462) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:29:23 devstack cinder-volume[86462]: DEBUG cinder.volume.drivers.quobyte [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=86462) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:29:23 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86462) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:29:23 devstack cinder-volume[86462]: DEBUG oslo_concurrency.processutils [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=86462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:29:23 devstack sudo[86680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:29:23 devstack sudo[86680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:29:24 devstack sudo[86680]: pam_unix(sudo:session): session closed for user root
Nov 07 02:29:24 devstack cinder-volume[86462]: DEBUG oslo_concurrency.processutils [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.483s {{(pid=86462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:29:24 devstack cinder-volume[86462]: INFO cinder.volume.manager [None req-abda487e-711d-4118-a12c-55c45ca05640 None None] Driver post RPC initialization completed successfully.
Nov 07 02:29:26 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-50eab00f-6cc2-4646-923b-843c082c0550 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86462) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:29:26 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-50eab00f-6cc2-4646-923b-843c082c0550 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86462) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:29:26 devstack cinder-volume[86462]: DEBUG cinder.volume.drivers.quobyte [None req-50eab00f-6cc2-4646-923b-843c082c0550 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=86462) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:29:26 devstack cinder-volume[86462]: DEBUG cinder.volume.drivers.quobyte [None req-50eab00f-6cc2-4646-923b-843c082c0550 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=86462) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:29:26 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-50eab00f-6cc2-4646-923b-843c082c0550 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86462) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:29:26 devstack cinder-volume[86462]: DEBUG oslo_concurrency.processutils [None req-50eab00f-6cc2-4646-923b-843c082c0550 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=86462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:29:26 devstack sudo[86695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:29:26 devstack sudo[86695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:29:27 devstack sudo[86695]: pam_unix(sudo:session): session closed for user root
Nov 07 02:29:27 devstack cinder-volume[86462]: DEBUG oslo_concurrency.processutils [None req-50eab00f-6cc2-4646-923b-843c082c0550 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.225s {{(pid=86462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:29:27 devstack cinder-volume[86462]: DEBUG cinder.manager [None req-50eab00f-6cc2-4646-923b-843c082c0550 None None] Notifying Schedulers of capabilities ... {{(pid=86462) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:29:30 devstack cinder-volume[86245]: INFO oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Caught SIGTERM, stopping children
Nov 07 02:29:30 devstack cinder-volume[86245]: DEBUG oslo_concurrency.lockutils [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Acquiring lock "singleton_lock" {{(pid=86245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 07 02:29:30 devstack cinder-volume[86245]: DEBUG oslo_concurrency.lockutils [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Acquired lock "singleton_lock" {{(pid=86245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 07 02:29:30 devstack cinder-volume[86245]: DEBUG oslo_concurrency.lockutils [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Releasing lock "singleton_lock" {{(pid=86245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 07 02:29:30 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Stop services. {{(pid=86245) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 07 02:29:30 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Killing children. {{(pid=86245) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 07 02:29:30 devstack cinder-volume[86245]: INFO oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Waiting on 1 children to exit
Nov 07 02:29:31 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Acquiring lock "singleton_lock" {{(pid=86462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 07 02:29:31 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Acquired lock "singleton_lock" {{(pid=86462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 07 02:29:31 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Releasing lock "singleton_lock" {{(pid=86462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 07 02:29:31 devstack cinder-volume[86462]: WARNING amqp [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 07 02:29:31 devstack cinder-volume[86462]: WARNING amqp [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 07 02:29:31 devstack cinder-volume[86245]: INFO oslo_service.backend._eventlet.service [None req-b52786c9-6575-4312-be3b-2c5c1872346d None None] Child 86462 exited with status 0
Nov 07 02:29:32 devstack cinder-volume[86769]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 07 02:29:32 devstack cinder-volume[86769]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 07 02:29:32 devstack cinder-volume[86769]: we strongly recommend against using it for new projects.
Nov 07 02:29:32 devstack cinder-volume[86769]: If you are already using Eventlet, we recommend migrating to a different
Nov 07 02:29:32 devstack cinder-volume[86769]: framework.  For more detail see
Nov 07 02:29:32 devstack cinder-volume[86769]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 07 02:29:32 devstack cinder-volume[86769]:   import eventlet  # noqa
Nov 07 02:29:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86769) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 07 02:29:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86769) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 07 02:29:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86769) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 07 02:29:36 devstack cinder-volume[86769]: INFO dbcounter [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] Registered counter for database cinder
Nov 07 02:29:36 devstack cinder-volume[86769]: DEBUG oslo_db.sqlalchemy.engines [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86769) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writer thread running {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 07 02:29:37 devstack cinder-volume[86769]: INFO cinder.rpc [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 07 02:29:37 devstack cinder-volume[86769]: INFO cinder.rpc [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_db.sqlalchemy.engines [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86769) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:29:37 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] Determined volume DB was empty at startup.
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86769) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 07 02:29:37 devstack cinder-volume[86769]: WARNING stevedore.named [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 07 02:29:37 devstack cinder-volume[86769]: WARNING castellan.key_manager [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 07 02:29:37 devstack cinder-volume[86769]: WARNING cinder.keymgr.conf_key_mgr [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 07 02:29:37 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_db.sqlalchemy.engines [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86769) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:29:37 devstack cinder-volume[86769]: INFO oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] Starting 1 workers
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] Started child 87054 {{(pid=86769) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] Full set of CONF: {{(pid=86769) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] ******************************************************************************** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] Configuration options gathered from: {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] ================================================================================ {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] allow_availability_zone_fallback = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[87054]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] allow_compression_on_image_upload = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] allowed_direct_url_schemes     = [] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] api_rate_limit                 = True {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] auth_strategy                  = keystone {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_availability_zone      = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_host                   = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_name                   = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_stats_polling_interval = 60 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backup_api_class               = cinder.backup.api.API {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backup_name_template           = backup-%s {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backup_use_same_host           = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backup_use_temp_snapshot       = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] chap_password                  = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] chap_username                  =  {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cinder_internal_tenant_project_id = 72b59c34f45f445faa2275c616b9f32a {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cinder_internal_tenant_user_id = 5a827a10a0414e30b4177ae503e31518 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cluster                        = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] compression_format             = gzip {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] config_dir                     = [] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] config_source                  = [] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] control_exchange               = openstack {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] debug                          = True {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] default_availability_zone      = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] default_group_type             = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] default_volume_type            = QuobyteHD {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] disk_geometry                  = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] driver_client_cert             = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] driver_client_cert_key         = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] driver_data_namespace          = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] driver_ssl_cert_path           = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] driver_ssl_cert_verify         = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] driver_use_ssl                 = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] enable_new_services            = True {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] enable_unsupported_driver      = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] enforce_multipath_for_image_xfer = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] filter_function                = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] glance_api_insecure            = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] glance_api_servers             = ['http://192.168.122.56/image'] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] glance_api_ssl_compression     = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] glance_ca_certificates_file    = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] glance_certfile                = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] glance_keyfile                 = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] glance_num_retries             = 3 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] glance_request_timeout         = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] goodness_function              = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] graceful_shutdown_timeout      = 5 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] group_api_class                = cinder.group.api.API {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] host                           = devstack {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] image_compress_on_upload       = True {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] image_conversion_address_space_limit = 1 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] image_conversion_cpu_limit     = 60 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] image_conversion_disable       = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] image_introspection_address_space_limit = 1 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] image_introspection_cpu_limit  = 60 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] image_upload_use_cinder_backend = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] image_upload_use_internal_tenant = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] image_volume_cache_enabled     = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] image_volume_cache_max_count   = 0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] image_volume_cache_max_size_gb = 0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] init_host_max_objects_retrieval = 0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 07 02:29:37 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87054) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] iscsi_target_flags             =  {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] iscsi_write_cache              = on {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] iser_helper                    = tgtadm {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] iser_ip_address                = 192.168.122.56 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] iser_port                      = 3260 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] log_color                      = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] log_config_append              = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] log_dir                        = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] log_file                       = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] log_options                    = True {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] log_rotate_interval            = 1 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] log_rotate_interval_type       = days {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] log_rotation_type              = none {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] max_age                        = 0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] max_logfile_count              = 30 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] max_logfile_size_mb            = 200 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] max_over_subscription_ratio    = 20.0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] message_reap_interval          = 86400 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] message_ttl                    = 2592000 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] migration_create_volume_timeout_secs = 300 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] monkey_patch                   = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] monkey_patch_modules           = [] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] my_ip                          = 192.168.122.56 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] no_snapshot_gb_quota           = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] num_iser_scan_tries            = 3 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] num_shell_tries                = 3 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] num_volume_device_scan_tries   = 3 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] nvmeof_conn_info_version       = 1 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] nvmet_ns_id                    = 10 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] nvmet_port_id                  = 1 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] osapi_max_limit                = 1000 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] osapi_volume_ext_list          = [] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] osapi_volume_listen_port       = 8776 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] osapi_volume_use_ssl           = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] osapi_volume_workers           = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] per_volume_size_limit          = -1 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] periodic_fuzzy_delay           = 60 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] periodic_interval              = 60 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] public_endpoint                = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] publish_errors                 = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] quota_backup_gigabytes         = 1000 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] quota_backups                  = 10 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] quota_gigabytes                = 1000 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] quota_groups                   = 10 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] quota_snapshots                = 10 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] quota_volumes                  = 10 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] rate_limit_burst               = 0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] rate_limit_except_level        = CRITICAL {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] rate_limit_interval            = 0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] reinit_driver_count            = 3 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] replication_device             = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] report_discard_supported       = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] report_interval                = 120 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] reservation_clean_interval     = 86400 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] reservation_expire             = 86400 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] reserved_image_namespaces      = [] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] reserved_percentage            = 0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] rpc_response_timeout           = 120 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] run_external_periodic_tasks    = True {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] scst_target_driver             = iscsi {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] scst_target_iqn_name           = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] service_down_time              = 720 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] shell_completion               = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] snapshot_name_template         = snapshot-%s {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] split_loggers                  = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] state_path                     = /opt/stack/data/cinder {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] storage_availability_zone      = nova {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] storage_protocol               = iSCSI {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] syslog_log_facility            = LOG_USER {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] target_helper                  = lioadm {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] target_ip_address              = 192.168.122.56 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] target_port                    = 3260 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] target_protocol                = iscsi {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] target_secondary_ip_addresses  = [] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] trace_flags                    = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] transport_url                  = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] until_refresh                  = 0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] use_chap_auth                  = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] use_default_quota_class        = True {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] use_journal                    = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] use_json                       = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] use_multipath_for_image_xfer   = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] use_stderr                     = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] use_syslog                     = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] verify_glance_signatures       = enabled {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] volume_api_class               = cinder.volume.api.API {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] volume_backend_name            = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] volume_clear                   = zero {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] volume_clear_ionice            = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] volume_clear_size              = 0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] volume_copy_bps_limit          = 0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] volume_dd_blocksize            = 1M {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] volume_name_template           = volume-%s {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] volume_service_inithost_offload = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] volume_usage_audit_period      = month {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] zoning_mode                    = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 07 02:29:37 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87054) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 07 02:29:37 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.quobyte [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 07 02:29:37 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.quobyte [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 07 02:29:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Running cmd (subprocess): mount.quobyte {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_concurrency.disable_process_locking = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.auth_section = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.auth_type   = password {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.auth_version = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.cache       = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.certfile    = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.include_service_catalog = True {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.insecure    = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.interface   = public {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.keyfile     = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.memcache_password = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack quobyte-client[87065]: Reading configuration file: /etc/quobyte/client.cfg
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.memcache_username = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack quobyte-client[87065]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.region_name = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.service_type = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.56/identity {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.backend                  = dogpile.cache.null {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.backend_argument         = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.backend_expiration_time  = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.config_prefix            = cache.oslo {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.debug_cache_backend      = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.enable_retry_client      = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.enable_socket_keepalive  = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.enabled                  = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.expiration_time          = 600 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.hashclient_retry_attempts = 2 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.memcache_dead_retry      = 300 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.memcache_sasl_enabled    = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.password                 = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.proxies                  = [] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.redis_db                 = 0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.redis_server             = localhost:6379 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.retry_attempts           = 2 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.retry_delay              = 0.0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.socket_keepalive_count   = 1 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.socket_keepalive_idle    = 1 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.socket_keepalive_interval = 1 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.socket_timeout           = 1.0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.tls_allowed_ciphers      = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.tls_cafile               = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.tls_certfile             = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.tls_enabled              = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.tls_keyfile              = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cache.username                 = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] coordination.backend_url       = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] database.asyncio_connection    = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] database.asyncio_slave_connection = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] database.backend               = sqlalchemy {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] database.connection            = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] database.connection_debug      = 0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] database.connection_parameters =  {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] database.connection_recycle_time = 3600 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] database.connection_trace      = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] database.db_inc_retry_interval = True {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] database.db_max_retries        = 20 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] database.db_max_retry_interval = 10 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] database.db_retry_interval     = 1 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] database.max_overflow          = 50 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] database.max_pool_size         = 5 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] database.max_retries           = 10 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] database.mysql_wsrep_sync_wait = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] database.pool_timeout          = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] database.retry_interval        = 10 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] database.slave_connection      = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] database.sqlite_synchronous    = True {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] database.synchronous_reader    = True {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] database.use_db_reconnect      = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_tracing.insecure = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] profiler.connection_string     = messaging:// {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] profiler.enabled               = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] profiler.es_doc_type           = notification {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] profiler.es_scroll_size        = 10000 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] profiler.es_scroll_time        = 2m {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] profiler.filter_error_trace    = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] profiler.hmac_keys             = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] profiler.sentinel_service_name = mymaster {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] profiler.socket_timeout        = 0.1 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] CMD "mount.quobyte" returned: 1 in 0.079s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] profiler.trace_requests        = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] profiler.trace_sqlalchemy      = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] profiler_jaeger.process_tags   = {} {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] profiler_jaeger.service_name_prefix = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] profiler_otlp.service_name_prefix = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_policy.enforce_new_defaults = True {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_policy.policy_default_rule = default {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] privsep_osbrick.group          = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] privsep_osbrick.helper_command = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] privsep_osbrick.user           = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cinder_sys_admin.group         = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cinder_sys_admin.helper_command = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] cinder_sys_admin.user          = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] service_user.auth_section      = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] service_user.auth_type         = password {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] service_user.cafile            = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] service_user.certfile          = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] service_user.collect_timing    = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:29:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:29:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] service_user.insecure          = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] service_user.keyfile           = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] service_user.send_service_user_token = True {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] service_user.split_loggers     = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] service_user.timeout           = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] service_user.tls_ciphers       = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] service_user.tls_min_version   = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] glance.auth_section            = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] glance.auth_type               = password {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] glance.certfile                = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] glance.collect_timing          = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] glance.insecure                = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] glance.keyfile                 = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] glance.region_name             = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] glance.split_loggers           = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] glance.timeout                 = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] glance.tls_ciphers             = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] glance.tls_min_version         = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.backend_availability_zone = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.chap_password = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.chap_username =  {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.disk_geometry = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.driver_client_cert = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.driver_client_cert_key = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.driver_data_namespace = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.driver_use_ssl = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.extra_capabilities = {} {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.filter_function = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.goodness_function = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack sudo[87066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.iscsi_target_flags =  {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.iscsi_write_cache = on {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack sudo[87066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.iser_ip_address = 192.168.122.56 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.iser_port     = 3260 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.nas_host      =  {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.nas_login     = admin {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.nas_mount_options = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.nas_password  = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.nas_private_key =  {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.nas_share_path =  {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.num_shell_tries = 3 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.quobyte_volume_url = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.replication_device = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.report_discard_supported = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.reserved_percentage = 0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.target_helper = tgtadm {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.target_ip_address = 192.168.122.56 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.target_port   = 3260 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.target_protocol = iscsi {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.trace_flags   = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.unique_fqdn_network = True {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.use_chap_auth = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.volume_backend_name = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.volume_clear  = zero {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.volume_clear_ionice = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.volume_clear_size = 0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_reports.file_event_handler = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_reports.log_dir           = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.backend_availability_zone = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.backend_host         = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.chap_password        = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.chap_username        = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.disk_geometry        = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.driver_client_cert   = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.driver_data_namespace = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.extra_capabilities   = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.filter_function      = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.goodness_function    = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.iser_helper          = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.iser_ip_address      = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.iser_port            = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.nas_host             = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.nas_login            = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.nas_mount_options    = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.nas_password         = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.nas_private_key      = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.nas_share_path       = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.num_shell_tries      = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:37 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.replication_device   = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.report_discard_supported = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.reserved_percentage  = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.scst_target_driver   = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.storage_protocol     = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.target_helper        = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.target_ip_address    = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.target_port          = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.target_prefix        = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.target_protocol      = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.trace_flags          = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.use_chap_auth        = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.volume_clear         = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.volume_clear_size    = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] QuobyteHD.volumes_dir          = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_notifications.driver = [] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_notifications.retry = -1 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] key_manager.fixed_key          = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican.barbican_api_version  = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican.barbican_endpoint     = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican.barbican_endpoint_type = public {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican.barbican_region_name  = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican.cafile                = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican.certfile              = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican.collect_timing        = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican.insecure              = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican.keyfile               = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican.number_of_retries     = 60 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican.retry_delay           = 1 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican.send_service_user_token = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican.split_loggers         = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican.timeout               = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican.tls_ciphers           = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican.tls_min_version       = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican.verify_ssl            = True {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican.verify_ssl_path       = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican_service_user.auth_section = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican_service_user.auth_type = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican_service_user.cafile   = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican_service_user.certfile = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican_service_user.collect_timing = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican_service_user.insecure = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican_service_user.keyfile  = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican_service_user.split_loggers = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican_service_user.timeout  = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican_service_user.tls_ciphers = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] barbican_service_user.tls_min_version = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] vault.approle_role_id          = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] vault.approle_secret_id        = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] vault.auth_method              = approle {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] vault.auth_path                = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] vault.kv_mountpoint            = secret {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] vault.kv_path                  = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] vault.kv_version               = 2 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] vault.namespace                = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] vault.root_token_id            = **** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] vault.ssl_ca_crt_file          = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] vault.timeout                  = 60.0 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] vault.token_file               = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] vault.token_role               = None {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] vault.use_ssl                  = False {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 07 02:29:38 devstack cinder-volume[86769]: DEBUG oslo_service.backend._eventlet.service [None req-6f9f7298-63ba-4f87-8de1-c21677eff703 None None] ******************************************************************************** {{(pid=86769) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 07 02:29:38 devstack sudo[87066]: pam_unix(sudo:session): session closed for user root
Nov 07 02:29:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.419s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:29:38 devstack cinder-volume[87054]: INFO cinder.volume.driver [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Driver hasn't implemented _init_vendor_properties()
Nov 07 02:29:38 devstack cinder-volume[87054]: DEBUG cinder.volume.driver [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7832832336426, 'free_capacity_gb': 1773.7832832336426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87054) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 07 02:29:38 devstack cinder-volume[87054]: DEBUG oslo_db.sqlalchemy.engines [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87054) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 07 02:29:38 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writer thread running {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 07 02:29:38 devstack cinder-volume[87054]: DEBUG cinder.db.api [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Building query based on filter {{(pid=87054) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 07 02:29:38 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87054) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 07 02:29:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:29:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:29:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:29:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:29:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:29:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:29:38 devstack cinder-volume[87054]: INFO cinder.keymgr.migration [None req-c0c3d085-5c60-40b2-9751-1681836c217f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 07 02:29:38 devstack sudo[87071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:29:38 devstack sudo[87071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:29:38 devstack sudo[87071]: pam_unix(sudo:session): session closed for user root
Nov 07 02:29:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.231s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:29:38 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:29:38 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Driver initialization completed successfully.
Nov 07 02:29:38 devstack cinder-volume[87054]: INFO cinder.manager [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Initiating service 3 cleanup
Nov 07 02:29:38 devstack cinder-volume[87054]: INFO cinder.manager [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Service 3 cleanup completed.
Nov 07 02:29:38 devstack cinder-volume[87054]: DEBUG cinder.service [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Creating RPC server for service cinder-volume {{(pid=87054) start /opt/stack/cinder/cinder/service.py:231}}
Nov 07 02:29:38 devstack cinder-volume[87054]: DEBUG cinder.service [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87054) start /opt/stack/cinder/cinder/service.py:237}}
Nov 07 02:29:38 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 07 02:29:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:29:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:29:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:29:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:29:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:29:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:29:38 devstack sudo[87082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:29:38 devstack sudo[87082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:29:39 devstack sudo[87082]: pam_unix(sudo:session): session closed for user root
Nov 07 02:29:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.233s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:29:39 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b83df22e-33a7-4854-a9aa-ec7fa96c337f None None] Driver post RPC initialization completed successfully.
Nov 07 02:29:47 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:29:48 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:29:49 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=3 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:29:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:29:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 6 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:29:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:30:43 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:30:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Flow 'volume_create_manager' (36fbb59c-62f5-474a-9669-ed88ccdf7081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:30:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59ee70a-b673-4dfa-8ac0-7386922bbeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:30:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59ee70a-b673-4dfa-8ac0-7386922bbeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1740091203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2905790e-0907-4c87-9bf8-da9f5c10f89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fa62b239fe4eb2ad8b433bb1ddbe94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:30:44Z,use_quota=True,user_id='3d882d18869847ec920d3b0007ba70ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:30:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea308316-48b9-4a35-b8bf-950cb28eae03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:30:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea308316-48b9-4a35-b8bf-950cb28eae03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:30:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a38e27d7-b4ec-470b-984a-82e64e364715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:30:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a38e27d7-b4ec-470b-984a-82e64e364715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2905790e-0907-4c87-9bf8-da9f5c10f89c', 'volume_name': 'volume-2905790e-0907-4c87-9bf8-da9f5c10f89c', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:30:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02835f32-6e8e-4bfc-b539-671e59ea59a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:30:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02835f32-6e8e-4bfc-b539-671e59ea59a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:30:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de43018-cc00-430c-8593-7dbf19232911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:30:44 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Volume 2905790e-0907-4c87-9bf8-da9f5c10f89c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2905790e-0907-4c87-9bf8-da9f5c10f89c', 'volume_size': 1}
Nov 07 02:30:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:30:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:30:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1740091203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2905790e-0907-4c87-9bf8-da9f5c10f89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fa62b239fe4eb2ad8b433bb1ddbe94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:30:44Z,use_quota=True,user_id='3d882d18869847ec920d3b0007ba70ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:30:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Creating volume 2905790e-0907-4c87-9bf8-da9f5c10f89c {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:30:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:30:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:30:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:30:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:30:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:30:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:30:44 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:30:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2905790e-0907-4c87-9bf8-da9f5c10f89c 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:30:44 devstack sudo[87676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2905790e-0907-4c87-9bf8-da9f5c10f89c 1073741824
Nov 07 02:30:44 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:30:45 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root
Nov 07 02:30:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2905790e-0907-4c87-9bf8-da9f5c10f89c 1073741824" returned: 0 in 1.408s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:30:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2905790e-0907-4c87-9bf8-da9f5c10f89c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:30:45 devstack sudo[88060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2905790e-0907-4c87-9bf8-da9f5c10f89c
Nov 07 02:30:45 devstack sudo[88060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:30:46 devstack sudo[88060]: pam_unix(sudo:session): session closed for user root
Nov 07 02:30:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2905790e-0907-4c87-9bf8-da9f5c10f89c" returned: 0 in 0.539s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:30:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] <== create_volume: return (2139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:30:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.146s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:30:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de43018-cc00-430c-8593-7dbf19232911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2905790e-0907-4c87-9bf8-da9f5c10f89c', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:30:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1f9e43-10ac-452f-8b60-b050982720d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:30:46 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Volume volume-2905790e-0907-4c87-9bf8-da9f5c10f89c (2905790e-0907-4c87-9bf8-da9f5c10f89c): created successfully
Nov 07 02:30:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1f9e43-10ac-452f-8b60-b050982720d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:30:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Flow 'volume_create_manager' (36fbb59c-62f5-474a-9669-ed88ccdf7081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:30:46 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-a8f40781-1719-43b3-ad58-63c097acac3c tempest-DeleteServersTestJSON-1439301527 None] Created volume successfully.
Nov 07 02:30:52 devstack cinder-volume[87054]: WARNING py.warnings [req-8b6c44bb-2fa2-4682-9aa6-7a25b11bca7d req-48f4a60c-c8df-442f-889b-6a09f569ea88 tempest-DeleteServersTestJSON-1439301527 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Nov 07 02:30:52 devstack cinder-volume[87054]:   .first()
Nov 07 02:30:52 devstack cinder-volume[87054]: 
Nov 07 02:30:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-8b6c44bb-2fa2-4682-9aa6-7a25b11bca7d req-48f4a60c-c8df-442f-889b-6a09f569ea88 tempest-DeleteServersTestJSON-1439301527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:30:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-8b6c44bb-2fa2-4682-9aa6-7a25b11bca7d req-48f4a60c-c8df-442f-889b-6a09f569ea88 tempest-DeleteServersTestJSON-1439301527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:30:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-8b6c44bb-2fa2-4682-9aa6-7a25b11bca7d req-48f4a60c-c8df-442f-889b-6a09f569ea88 tempest-DeleteServersTestJSON-1439301527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:30:52 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-8b6c44bb-2fa2-4682-9aa6-7a25b11bca7d req-48f4a60c-c8df-442f-889b-6a09f569ea88 tempest-DeleteServersTestJSON-1439301527 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c', 'name': 'volume-2905790e-0907-4c87-9bf8-da9f5c10f89c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29af4bb4-c806-4630-9895-1a44c0a7f09a', 'enforce_multipath': True} {{(pid=87054) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:30:52 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-8b6c44bb-2fa2-4682-9aa6-7a25b11bca7d req-48f4a60c-c8df-442f-889b-6a09f569ea88 tempest-DeleteServersTestJSON-1439301527 None] attachment_update completed successfully.
Nov 07 02:30:58 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-cd58a520-280a-4e25-b754-2451ce361628 req-e0e94ead-3e74-42a9-90e7-37e7febd86dc tempest-DeleteServersTestJSON-1439301527 None] Terminate volume connection completed successfully.
Nov 07 02:30:58 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-cd58a520-280a-4e25-b754-2451ce361628 req-e0e94ead-3e74-42a9-90e7-37e7febd86dc tempest-DeleteServersTestJSON-1439301527 None] Deleting attachment 29af4bb4-c806-4630-9895-1a44c0a7f09a. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:30:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:30:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:30:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:30:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:30:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:30:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:30:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:30:59 devstack sudo[88670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:30:59 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:30:59 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root
Nov 07 02:30:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.672s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:30:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:30:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:30:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 6 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:30:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:31:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] Acquiring lock "cinder-2905790e-0907-4c87-9bf8-da9f5c10f89c-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:31:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] Lock "cinder-2905790e-0907-4c87-9bf8-da9f5c10f89c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:31:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] Acquiring lock "cinder-quobyte-2905790e-0907-4c87-9bf8-da9f5c10f89c" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:31:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] Lock "cinder-quobyte-2905790e-0907-4c87-9bf8-da9f5c10f89c" acquired by "delete_volume" :: waited 0.046s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:31:01 devstack cinder-volume[87054]: INFO oslo.privsep.daemon [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpkilnkpzr/privsep.sock']
Nov 07 02:31:01 devstack sudo[88762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpkilnkpzr/privsep.sock
Nov 07 02:31:01 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:02 devstack cinder-volume[87054]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Nov 07 02:31:02 devstack cinder-volume[87054]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 07 02:31:02 devstack cinder-volume[87054]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Nov 07 02:31:02 devstack cinder-volume[87054]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 07 02:31:02 devstack cinder-volume[87054]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Nov 07 02:31:02 devstack cinder-volume[87054]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Nov 07 02:31:02 devstack cinder-volume[87054]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 07 02:31:02 devstack cinder-volume[87054]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 07 02:31:02 devstack cinder-volume[87054]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Nov 07 02:31:03 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:03 devstack cinder-volume[87054]: INFO oslo.privsep.daemon [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] Spawned new privsep daemon via rootwrap
Nov 07 02:31:03 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] Accepted privsep connection to /tmp/tmpkilnkpzr/privsep.sock {{(pid=87054) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Nov 07 02:31:03 devstack cinder-volume[87054]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 07 02:31:03 devstack cinder-volume[87054]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 07 02:31:03 devstack cinder-volume[87054]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 07 02:31:03 devstack cinder-volume[87054]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88768
Nov 07 02:31:03 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8ece72-fa55-4be2-8992-ddcaa6bdb0fd]: (2,) {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:31:03 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5fad56-4101-48ef-b204-d7bb30e331d0]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:31:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2905790e-0907-4c87-9bf8-da9f5c10f89c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:03 devstack sudo[88770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2905790e-0907-4c87-9bf8-da9f5c10f89c
Nov 07 02:31:03 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:03 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2905790e-0907-4c87-9bf8-da9f5c10f89c" returned: 0 in 0.530s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2905790e-0907-4c87-9bf8-da9f5c10f89c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:03 devstack sudo[88775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2905790e-0907-4c87-9bf8-da9f5c10f89c
Nov 07 02:31:03 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:03 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2905790e-0907-4c87-9bf8-da9f5c10f89c" returned: 0 in 0.297s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:03 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] Lock "cinder-quobyte-2905790e-0907-4c87-9bf8-da9f5c10f89c" released by "delete_volume" :: held 2.301s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:31:04 devstack cinder-volume[87054]: WARNING cinder.quota [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:31:04 devstack cinder-volume[87054]: WARNING cinder.quota [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] Created reservations ['e2aa240b-6d2a-4e35-878b-438528f8b1fe', '980ddb9e-609a-485a-a854-b231aa739a38', '271be454-5b2e-46e0-a8f5-6fd18f56d45f', 'c4fce09f-b4e7-4166-9328-c742352d3c81'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Flow 'volume_create_manager' (a4f0ecca-a07d-4953-9cf2-87b25afc678f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0154a9ef-1827-47e7-9f7a-ebd3b6e55ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0154a9ef-1827-47e7-9f7a-ebd3b6e55ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1043333286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f27519a7-a7ca-4195-87de-7709406d731b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef9f9b487ba84ebbb58574baab268400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:31:04Z,use_quota=True,user_id='5be9678596ff442fa17e8a09c5e4c16e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a33a96-e37a-42d1-b476-09570e9e78b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a33a96-e37a-42d1-b476-09570e9e78b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d63124-0850-4db4-9caf-b14e2d732162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d63124-0850-4db4-9caf-b14e2d732162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f27519a7-a7ca-4195-87de-7709406d731b', 'volume_name': 'volume-f27519a7-a7ca-4195-87de-7709406d731b', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c028c90d-03c7-4558-8381-e4bed4d5c3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c028c90d-03c7-4558-8381-e4bed4d5c3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222a1680-2e2c-4091-a525-e337335a717e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:04 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Volume f27519a7-a7ca-4195-87de-7709406d731b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f27519a7-a7ca-4195-87de-7709406d731b', 'volume_size': 1}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1043333286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f27519a7-a7ca-4195-87de-7709406d731b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef9f9b487ba84ebbb58574baab268400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:31:04Z,use_quota=True,user_id='5be9678596ff442fa17e8a09c5e4c16e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Creating volume f27519a7-a7ca-4195-87de-7709406d731b {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:31:04 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f27519a7-a7ca-4195-87de-7709406d731b 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:04 devstack sudo[88779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f27519a7-a7ca-4195-87de-7709406d731b 1073741824
Nov 07 02:31:04 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:04 devstack sudo[88781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:31:04 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:04 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.393s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:31:04 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] Deleted volume successfully.
Nov 07 02:31:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b740c8b9-4e15-4cce-912e-afb1d849c07f tempest-DeleteServersTestJSON-1439301527 None] Lock "cinder-2905790e-0907-4c87-9bf8-da9f5c10f89c-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:31:05 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f27519a7-a7ca-4195-87de-7709406d731b 1073741824" returned: 0 in 0.798s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f27519a7-a7ca-4195-87de-7709406d731b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:05 devstack sudo[88788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f27519a7-a7ca-4195-87de-7709406d731b
Nov 07 02:31:05 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:05 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f27519a7-a7ca-4195-87de-7709406d731b" returned: 0 in 0.350s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:31:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222a1680-2e2c-4091-a525-e337335a717e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f27519a7-a7ca-4195-87de-7709406d731b', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e814f5eb-5c84-4e3c-b3a6-9bb82ca94bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:05 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Volume volume-f27519a7-a7ca-4195-87de-7709406d731b (f27519a7-a7ca-4195-87de-7709406d731b): created successfully
Nov 07 02:31:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e814f5eb-5c84-4e3c-b3a6-9bb82ca94bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Flow 'volume_create_manager' (a4f0ecca-a07d-4953-9cf2-87b25afc678f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:31:05 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-2c00613b-59be-4b77-af1a-41d5647f78be tempest-VolumesAdminNegativeTest-1970904113 None] Created volume successfully.
Nov 07 02:31:06 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f25d2cf4-ac95-462f-b533-aa9ee414c797 tempest-VolumesAdminNegativeTest-1970904113 None] Acquiring lock "cinder-f27519a7-a7ca-4195-87de-7709406d731b-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:31:06 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f25d2cf4-ac95-462f-b533-aa9ee414c797 tempest-VolumesAdminNegativeTest-1970904113 None] Lock "cinder-f27519a7-a7ca-4195-87de-7709406d731b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:31:06 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f25d2cf4-ac95-462f-b533-aa9ee414c797 tempest-VolumesAdminNegativeTest-1970904113 None] Acquiring lock "cinder-quobyte-f27519a7-a7ca-4195-87de-7709406d731b" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:31:06 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f25d2cf4-ac95-462f-b533-aa9ee414c797 tempest-VolumesAdminNegativeTest-1970904113 None] Lock "cinder-quobyte-f27519a7-a7ca-4195-87de-7709406d731b" acquired by "delete_volume" :: waited 0.024s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:31:06 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[04415a85-d821-4f7c-ac09-48764066b818]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:31:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f25d2cf4-ac95-462f-b533-aa9ee414c797 tempest-VolumesAdminNegativeTest-1970904113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f27519a7-a7ca-4195-87de-7709406d731b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:06 devstack sudo[88792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f27519a7-a7ca-4195-87de-7709406d731b
Nov 07 02:31:06 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:07 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f25d2cf4-ac95-462f-b533-aa9ee414c797 tempest-VolumesAdminNegativeTest-1970904113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f27519a7-a7ca-4195-87de-7709406d731b" returned: 0 in 0.517s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f25d2cf4-ac95-462f-b533-aa9ee414c797 tempest-VolumesAdminNegativeTest-1970904113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f27519a7-a7ca-4195-87de-7709406d731b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:07 devstack sudo[88800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f27519a7-a7ca-4195-87de-7709406d731b
Nov 07 02:31:07 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:07 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f25d2cf4-ac95-462f-b533-aa9ee414c797 tempest-VolumesAdminNegativeTest-1970904113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f27519a7-a7ca-4195-87de-7709406d731b" returned: 0 in 0.530s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f25d2cf4-ac95-462f-b533-aa9ee414c797 tempest-VolumesAdminNegativeTest-1970904113 None] Lock "cinder-quobyte-f27519a7-a7ca-4195-87de-7709406d731b" released by "delete_volume" :: held 1.132s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:31:07 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-f25d2cf4-ac95-462f-b533-aa9ee414c797 tempest-VolumesAdminNegativeTest-1970904113 None] Created reservations ['89d9e2a6-cf4f-4078-822c-c489dd1a65a9', '861896e1-1c49-44fd-92a6-037d5c56e267', '33bbdb69-93fd-4e82-a5fd-e404a42235ed', '2d3b6f9f-a193-4c77-9218-95ebcebac0ec'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:31:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f25d2cf4-ac95-462f-b533-aa9ee414c797 tempest-VolumesAdminNegativeTest-1970904113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f25d2cf4-ac95-462f-b533-aa9ee414c797 tempest-VolumesAdminNegativeTest-1970904113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f25d2cf4-ac95-462f-b533-aa9ee414c797 tempest-VolumesAdminNegativeTest-1970904113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:31:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f25d2cf4-ac95-462f-b533-aa9ee414c797 tempest-VolumesAdminNegativeTest-1970904113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:31:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f25d2cf4-ac95-462f-b533-aa9ee414c797 tempest-VolumesAdminNegativeTest-1970904113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f25d2cf4-ac95-462f-b533-aa9ee414c797 tempest-VolumesAdminNegativeTest-1970904113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:08 devstack sudo[88803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:31:08 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:08 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f25d2cf4-ac95-462f-b533-aa9ee414c797 tempest-VolumesAdminNegativeTest-1970904113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.537s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:08 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-f25d2cf4-ac95-462f-b533-aa9ee414c797 tempest-VolumesAdminNegativeTest-1970904113 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:31:08 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f25d2cf4-ac95-462f-b533-aa9ee414c797 tempest-VolumesAdminNegativeTest-1970904113 None] Deleted volume successfully.
Nov 07 02:31:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f25d2cf4-ac95-462f-b533-aa9ee414c797 tempest-VolumesAdminNegativeTest-1970904113 None] Lock "cinder-f27519a7-a7ca-4195-87de-7709406d731b-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Flow 'volume_create_manager' (aaae3144-2e90-4ed5-a48a-10a41eccf12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (631285af-bdf8-4ffa-9943-0e351bc5fc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (631285af-bdf8-4ffa-9943-0e351bc5fc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-435985321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba7d1b04-0b01-4a25-814f-d1b21416ed62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dd788500c204012adc414f34880140a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:31:14Z,use_quota=True,user_id='f0315fe520ad472580ca60c3e9365e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd28f74-d2d5-4bb6-95ec-caf1038dfd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd28f74-d2d5-4bb6-95ec-caf1038dfd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (804fdb8b-2a20-4e83-8170-29743a6ba738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (804fdb8b-2a20-4e83-8170-29743a6ba738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba7d1b04-0b01-4a25-814f-d1b21416ed62', 'volume_name': 'volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9a8313-67d8-488e-a430-12780d4f1d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9a8313-67d8-488e-a430-12780d4f1d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70abb0c-632e-49b8-916c-25fd6dd01a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:14 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Volume ba7d1b04-0b01-4a25-814f-d1b21416ed62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62', 'volume_size': 1}
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-435985321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba7d1b04-0b01-4a25-814f-d1b21416ed62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dd788500c204012adc414f34880140a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:31:14Z,use_quota=True,user_id='f0315fe520ad472580ca60c3e9365e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Creating volume ba7d1b04-0b01-4a25-814f-d1b21416ed62 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:31:14 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:14 devstack sudo[88844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62 1073741824
Nov 07 02:31:14 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:31:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Flow 'volume_create_manager' (9e88e5a0-2157-43cb-83d2-3b72704edf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309f4966-318e-4152-8f99-759c716d8e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309f4966-318e-4152-8f99-759c716d8e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1864058556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee79c99-ae8a-4f68-9c30-057b1e43765b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce23fa767b241528aa76f1dfc112efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:31:15Z,use_quota=True,user_id='5f7f037ad61d4f44927aed2fa7040452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01b5cd7-30e7-4566-aad3-67859e4f9210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01b5cd7-30e7-4566-aad3-67859e4f9210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ee68dc-b4c3-4756-84d9-881b3dfb9676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ee68dc-b4c3-4756-84d9-881b3dfb9676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ee79c99-ae8a-4f68-9c30-057b1e43765b', 'volume_name': 'volume-6ee79c99-ae8a-4f68-9c30-057b1e43765b', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:15 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (690e72da-e3f0-494a-92c4-17ca4afc9eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (690e72da-e3f0-494a-92c4-17ca4afc9eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d6b1bd-e0f7-4c2d-aa2d-a4f1f8544f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:15 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Volume 6ee79c99-ae8a-4f68-9c30-057b1e43765b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ee79c99-ae8a-4f68-9c30-057b1e43765b', 'volume_size': 1}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62 1073741824" returned: 0 in 0.652s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:15 devstack sudo[88850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62
Nov 07 02:31:15 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:15 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62" returned: 0 in 0.278s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.334s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1864058556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee79c99-ae8a-4f68-9c30-057b1e43765b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce23fa767b241528aa76f1dfc112efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:31:15Z,use_quota=True,user_id='5f7f037ad61d4f44927aed2fa7040452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Creating volume 6ee79c99-ae8a-4f68-9c30-057b1e43765b {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:31:15 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6ee79c99-ae8a-4f68-9c30-057b1e43765b 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70abb0c-632e-49b8-916c-25fd6dd01a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:15 devstack sudo[88853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6ee79c99-ae8a-4f68-9c30-057b1e43765b 1073741824
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc089ee-0627-4a0e-ad48-93e60a604582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:15 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:15 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Volume volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62 (ba7d1b04-0b01-4a25-814f-d1b21416ed62): created successfully
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc089ee-0627-4a0e-ad48-93e60a604582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Flow 'volume_create_manager' (aaae3144-2e90-4ed5-a48a-10a41eccf12d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:31:15 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-f05b3ed5-00f5-4bf6-98dd-054a0a70c67f req-131bb7c1-f58a-4f36-a4e4-c452bcc54ef3 tempest-VolumesSnapshotsTestJSON-521276636 None] Created volume successfully.
Nov 07 02:31:15 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6ee79c99-ae8a-4f68-9c30-057b1e43765b 1073741824" returned: 0 in 0.539s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6ee79c99-ae8a-4f68-9c30-057b1e43765b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:16 devstack sudo[88859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6ee79c99-ae8a-4f68-9c30-057b1e43765b
Nov 07 02:31:16 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:16 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6ee79c99-ae8a-4f68-9c30-057b1e43765b" returned: 0 in 0.268s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:31:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d6b1bd-e0f7-4c2d-aa2d-a4f1f8544f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ee79c99-ae8a-4f68-9c30-057b1e43765b', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7986ccfe-bb37-4aad-a07f-c688fb7e091d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:16 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Volume volume-6ee79c99-ae8a-4f68-9c30-057b1e43765b (6ee79c99-ae8a-4f68-9c30-057b1e43765b): created successfully
Nov 07 02:31:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7986ccfe-bb37-4aad-a07f-c688fb7e091d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Flow 'volume_create_manager' (9e88e5a0-2157-43cb-83d2-3b72704edf6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:31:16 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-745a7532-8299-4097-bf07-219d85eef9da tempest-ServerActionsTestOtherA-715488085 None] Created volume successfully.
Nov 07 02:31:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-87a4f06c-ab2c-4963-a28a-ccfa2b716232 req-edfca769-9204-4b34-bc71-79bc82405333 tempest-VolumesSnapshotsTestJSON-521276636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-87a4f06c-ab2c-4963-a28a-ccfa2b716232 req-edfca769-9204-4b34-bc71-79bc82405333 tempest-VolumesSnapshotsTestJSON-521276636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [req-87a4f06c-ab2c-4963-a28a-ccfa2b716232 req-edfca769-9204-4b34-bc71-79bc82405333 tempest-VolumesSnapshotsTestJSON-521276636 None] Creating offline snapshot cc506837-58e0-478d-93b2-e708bdb06794 of volume ba7d1b04-0b01-4a25-814f-d1b21416ed62 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:31:16 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22c1b5c-c32c-429b-a695-497c64dad0a9]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:31:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-87a4f06c-ab2c-4963-a28a-ccfa2b716232 req-edfca769-9204-4b34-bc71-79bc82405333 tempest-VolumesSnapshotsTestJSON-521276636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:17 devstack sudo[88863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62
Nov 07 02:31:17 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:17 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-87a4f06c-ab2c-4963-a28a-ccfa2b716232 req-edfca769-9204-4b34-bc71-79bc82405333 tempest-VolumesSnapshotsTestJSON-521276636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62" returned: 0 in 0.465s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-87a4f06c-ab2c-4963-a28a-ccfa2b716232 req-edfca769-9204-4b34-bc71-79bc82405333 tempest-VolumesSnapshotsTestJSON-521276636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.cc506837-58e0-478d-93b2-e708bdb06794 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:17 devstack sudo[88868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.cc506837-58e0-478d-93b2-e708bdb06794 1G
Nov 07 02:31:17 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:17 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-87a4f06c-ab2c-4963-a28a-ccfa2b716232 req-edfca769-9204-4b34-bc71-79bc82405333 tempest-VolumesSnapshotsTestJSON-521276636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.cc506837-58e0-478d-93b2-e708bdb06794 1G" returned: 0 in 0.489s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-87a4f06c-ab2c-4963-a28a-ccfa2b716232 req-edfca769-9204-4b34-bc71-79bc82405333 tempest-VolumesSnapshotsTestJSON-521276636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.cc506837-58e0-478d-93b2-e708bdb06794 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:17 devstack sudo[88874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.cc506837-58e0-478d-93b2-e708bdb06794
Nov 07 02:31:17 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:18 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-87a4f06c-ab2c-4963-a28a-ccfa2b716232 req-edfca769-9204-4b34-bc71-79bc82405333 tempest-VolumesSnapshotsTestJSON-521276636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.cc506837-58e0-478d-93b2-e708bdb06794" returned: 0 in 0.340s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:18 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [req-87a4f06c-ab2c-4963-a28a-ccfa2b716232 req-edfca769-9204-4b34-bc71-79bc82405333 tempest-VolumesSnapshotsTestJSON-521276636 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.cc506837-58e0-478d-93b2-e708bdb06794 is being set with open permissions: ugo+rw
Nov 07 02:31:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-87a4f06c-ab2c-4963-a28a-ccfa2b716232 req-edfca769-9204-4b34-bc71-79bc82405333 tempest-VolumesSnapshotsTestJSON-521276636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.cc506837-58e0-478d-93b2-e708bdb06794 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:18 devstack sudo[88880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.cc506837-58e0-478d-93b2-e708bdb06794
Nov 07 02:31:18 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:18 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-87a4f06c-ab2c-4963-a28a-ccfa2b716232 req-edfca769-9204-4b34-bc71-79bc82405333 tempest-VolumesSnapshotsTestJSON-521276636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.cc506837-58e0-478d-93b2-e708bdb06794" returned: 0 in 0.273s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-87a4f06c-ab2c-4963-a28a-ccfa2b716232 req-edfca769-9204-4b34-bc71-79bc82405333 tempest-VolumesSnapshotsTestJSON-521276636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:18 devstack sudo[88883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.info
Nov 07 02:31:18 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:18 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-87a4f06c-ab2c-4963-a28a-ccfa2b716232 req-edfca769-9204-4b34-bc71-79bc82405333 tempest-VolumesSnapshotsTestJSON-521276636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.info" returned: 0 in 0.298s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:18 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [req-87a4f06c-ab2c-4963-a28a-ccfa2b716232 req-edfca769-9204-4b34-bc71-79bc82405333 tempest-VolumesSnapshotsTestJSON-521276636 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.info is being set with open permissions: ugo+rw
Nov 07 02:31:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-87a4f06c-ab2c-4963-a28a-ccfa2b716232 req-edfca769-9204-4b34-bc71-79bc82405333 tempest-VolumesSnapshotsTestJSON-521276636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:18 devstack sudo[88886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.info
Nov 07 02:31:18 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:19 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-87a4f06c-ab2c-4963-a28a-ccfa2b716232 req-edfca769-9204-4b34-bc71-79bc82405333 tempest-VolumesSnapshotsTestJSON-521276636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.info" returned: 0 in 0.333s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-87a4f06c-ab2c-4963-a28a-ccfa2b716232 req-edfca769-9204-4b34-bc71-79bc82405333 tempest-VolumesSnapshotsTestJSON-521276636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.332s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:19 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-87a4f06c-ab2c-4963-a28a-ccfa2b716232 req-edfca769-9204-4b34-bc71-79bc82405333 tempest-VolumesSnapshotsTestJSON-521276636 None] Create snapshot completed successfully
Nov 07 02:31:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-e3744ae8-4ebc-4367-bacf-5e4a5155b99f req-b194c009-6e97-4534-a9d7-1fb5a71b646b tempest-VolumesSnapshotsTestJSON-521276636 None] Acquiring lock "cinder-cc506837-58e0-478d-93b2-e708bdb06794-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:31:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-e3744ae8-4ebc-4367-bacf-5e4a5155b99f req-b194c009-6e97-4534-a9d7-1fb5a71b646b tempest-VolumesSnapshotsTestJSON-521276636 None] Lock "cinder-cc506837-58e0-478d-93b2-e708bdb06794-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:31:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-e3744ae8-4ebc-4367-bacf-5e4a5155b99f req-b194c009-6e97-4534-a9d7-1fb5a71b646b tempest-VolumesSnapshotsTestJSON-521276636 None] Acquiring lock "cinder-quobyte-ba7d1b04-0b01-4a25-814f-d1b21416ed62" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:31:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-e3744ae8-4ebc-4367-bacf-5e4a5155b99f req-b194c009-6e97-4534-a9d7-1fb5a71b646b tempest-VolumesSnapshotsTestJSON-521276636 None] Lock "cinder-quobyte-ba7d1b04-0b01-4a25-814f-d1b21416ed62" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:31:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-e3744ae8-4ebc-4367-bacf-5e4a5155b99f req-b194c009-6e97-4534-a9d7-1fb5a71b646b tempest-VolumesSnapshotsTestJSON-521276636 None] Acquiring lock "cinder-quobyte-cc506837-58e0-478d-93b2-e708bdb06794" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:31:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-e3744ae8-4ebc-4367-bacf-5e4a5155b99f req-b194c009-6e97-4534-a9d7-1fb5a71b646b tempest-VolumesSnapshotsTestJSON-521276636 None] Lock "cinder-quobyte-cc506837-58e0-478d-93b2-e708bdb06794" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:31:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [req-e3744ae8-4ebc-4367-bacf-5e4a5155b99f req-b194c009-6e97-4534-a9d7-1fb5a71b646b tempest-VolumesSnapshotsTestJSON-521276636 None] Deleting offline snapshot cc506837-58e0-478d-93b2-e708bdb06794 of volume ba7d1b04-0b01-4a25-814f-d1b21416ed62 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:31:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [req-e3744ae8-4ebc-4367-bacf-5e4a5155b99f req-b194c009-6e97-4534-a9d7-1fb5a71b646b tempest-VolumesSnapshotsTestJSON-521276636 None] snapshot_file for this snap is: volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.cc506837-58e0-478d-93b2-e708bdb06794 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:31:19 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b26c5e6-ebaa-40ba-8ddd-7189a59bb278]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:31:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-e3744ae8-4ebc-4367-bacf-5e4a5155b99f req-b194c009-6e97-4534-a9d7-1fb5a71b646b tempest-VolumesSnapshotsTestJSON-521276636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.cc506837-58e0-478d-93b2-e708bdb06794 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:19 devstack sudo[88890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.cc506837-58e0-478d-93b2-e708bdb06794
Nov 07 02:31:19 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:20 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-e3744ae8-4ebc-4367-bacf-5e4a5155b99f req-b194c009-6e97-4534-a9d7-1fb5a71b646b tempest-VolumesSnapshotsTestJSON-521276636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.cc506837-58e0-478d-93b2-e708bdb06794" returned: 0 in 0.429s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [req-e3744ae8-4ebc-4367-bacf-5e4a5155b99f req-b194c009-6e97-4534-a9d7-1fb5a71b646b tempest-VolumesSnapshotsTestJSON-521276636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:31:20 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fc9be6-fc35-48ed-8451-2b671d76f8e2]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:31:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-e3744ae8-4ebc-4367-bacf-5e4a5155b99f req-b194c009-6e97-4534-a9d7-1fb5a71b646b tempest-VolumesSnapshotsTestJSON-521276636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:20 devstack sudo[88896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62
Nov 07 02:31:20 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:20 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-e3744ae8-4ebc-4367-bacf-5e4a5155b99f req-b194c009-6e97-4534-a9d7-1fb5a71b646b tempest-VolumesSnapshotsTestJSON-521276636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62" returned: 0 in 0.384s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-e3744ae8-4ebc-4367-bacf-5e4a5155b99f req-b194c009-6e97-4534-a9d7-1fb5a71b646b tempest-VolumesSnapshotsTestJSON-521276636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.cc506837-58e0-478d-93b2-e708bdb06794 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:20 devstack sudo[88901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.cc506837-58e0-478d-93b2-e708bdb06794
Nov 07 02:31:20 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:21 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-e3744ae8-4ebc-4367-bacf-5e4a5155b99f req-b194c009-6e97-4534-a9d7-1fb5a71b646b tempest-VolumesSnapshotsTestJSON-521276636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.cc506837-58e0-478d-93b2-e708bdb06794" returned: 0 in 0.471s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-e3744ae8-4ebc-4367-bacf-5e4a5155b99f req-b194c009-6e97-4534-a9d7-1fb5a71b646b tempest-VolumesSnapshotsTestJSON-521276636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.cc506837-58e0-478d-93b2-e708bdb06794 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:21 devstack sudo[88906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.cc506837-58e0-478d-93b2-e708bdb06794
Nov 07 02:31:21 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:21 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-e3744ae8-4ebc-4367-bacf-5e4a5155b99f req-b194c009-6e97-4534-a9d7-1fb5a71b646b tempest-VolumesSnapshotsTestJSON-521276636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62.cc506837-58e0-478d-93b2-e708bdb06794" returned: 0 in 0.298s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-e3744ae8-4ebc-4367-bacf-5e4a5155b99f req-b194c009-6e97-4534-a9d7-1fb5a71b646b tempest-VolumesSnapshotsTestJSON-521276636 None] Lock "cinder-quobyte-cc506837-58e0-478d-93b2-e708bdb06794" released by "_delete_snapshot" :: held 1.766s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:31:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-e3744ae8-4ebc-4367-bacf-5e4a5155b99f req-b194c009-6e97-4534-a9d7-1fb5a71b646b tempest-VolumesSnapshotsTestJSON-521276636 None] Lock "cinder-quobyte-ba7d1b04-0b01-4a25-814f-d1b21416ed62" released by "delete_snapshot" :: held 1.807s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:31:21 devstack cinder-volume[87054]: WARNING cinder.quota [req-e3744ae8-4ebc-4367-bacf-5e4a5155b99f req-b194c009-6e97-4534-a9d7-1fb5a71b646b tempest-VolumesSnapshotsTestJSON-521276636 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:31:21 devstack cinder-volume[87054]: DEBUG cinder.quota [req-e3744ae8-4ebc-4367-bacf-5e4a5155b99f req-b194c009-6e97-4534-a9d7-1fb5a71b646b tempest-VolumesSnapshotsTestJSON-521276636 None] Created reservations ['9fb623fa-8d29-4402-9408-51b4025f3eb0', '48a356de-05a2-482c-b32e-6ed48ba7ef6e', '0ff80e59-1175-4bf4-b7cb-3a721506b26b', 'be9fc22d-6331-4d02-9d4a-18f9784d89f4'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:31:21 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-e3744ae8-4ebc-4367-bacf-5e4a5155b99f req-b194c009-6e97-4534-a9d7-1fb5a71b646b tempest-VolumesSnapshotsTestJSON-521276636 None] Delete snapshot completed successfully.
Nov 07 02:31:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-e3744ae8-4ebc-4367-bacf-5e4a5155b99f req-b194c009-6e97-4534-a9d7-1fb5a71b646b tempest-VolumesSnapshotsTestJSON-521276636 None] Lock "cinder-cc506837-58e0-478d-93b2-e708bdb06794-delete_snapshot" released by "delete_snapshot" :: held 1.980s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:31:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-3428a2b1-8d2e-492b-b955-42b4e6bfeb08 req-0a7a4598-105d-4729-84d5-1c59754ede40 tempest-VolumesSnapshotsTestJSON-521276636 None] Acquiring lock "cinder-ba7d1b04-0b01-4a25-814f-d1b21416ed62-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:31:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-3428a2b1-8d2e-492b-b955-42b4e6bfeb08 req-0a7a4598-105d-4729-84d5-1c59754ede40 tempest-VolumesSnapshotsTestJSON-521276636 None] Lock "cinder-ba7d1b04-0b01-4a25-814f-d1b21416ed62-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:31:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-3428a2b1-8d2e-492b-b955-42b4e6bfeb08 req-0a7a4598-105d-4729-84d5-1c59754ede40 tempest-VolumesSnapshotsTestJSON-521276636 None] Acquiring lock "cinder-quobyte-ba7d1b04-0b01-4a25-814f-d1b21416ed62" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:31:22 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-3428a2b1-8d2e-492b-b955-42b4e6bfeb08 req-0a7a4598-105d-4729-84d5-1c59754ede40 tempest-VolumesSnapshotsTestJSON-521276636 None] Lock "cinder-quobyte-ba7d1b04-0b01-4a25-814f-d1b21416ed62" acquired by "delete_volume" :: waited 0.027s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:31:22 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc86c8e-41be-40a1-a24a-88878c11519a]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:31:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-3428a2b1-8d2e-492b-b955-42b4e6bfeb08 req-0a7a4598-105d-4729-84d5-1c59754ede40 tempest-VolumesSnapshotsTestJSON-521276636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:22 devstack sudo[88909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62
Nov 07 02:31:22 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:22 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-3428a2b1-8d2e-492b-b955-42b4e6bfeb08 req-0a7a4598-105d-4729-84d5-1c59754ede40 tempest-VolumesSnapshotsTestJSON-521276636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62" returned: 0 in 0.455s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-3428a2b1-8d2e-492b-b955-42b4e6bfeb08 req-0a7a4598-105d-4729-84d5-1c59754ede40 tempest-VolumesSnapshotsTestJSON-521276636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:22 devstack sudo[88915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62
Nov 07 02:31:22 devstack sudo[88915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:22 devstack sudo[88915]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-3428a2b1-8d2e-492b-b955-42b4e6bfeb08 req-0a7a4598-105d-4729-84d5-1c59754ede40 tempest-VolumesSnapshotsTestJSON-521276636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba7d1b04-0b01-4a25-814f-d1b21416ed62" returned: 0 in 0.287s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:22 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-3428a2b1-8d2e-492b-b955-42b4e6bfeb08 req-0a7a4598-105d-4729-84d5-1c59754ede40 tempest-VolumesSnapshotsTestJSON-521276636 None] Lock "cinder-quobyte-ba7d1b04-0b01-4a25-814f-d1b21416ed62" released by "delete_volume" :: held 0.832s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:31:22 devstack cinder-volume[87054]: DEBUG cinder.quota [req-3428a2b1-8d2e-492b-b955-42b4e6bfeb08 req-0a7a4598-105d-4729-84d5-1c59754ede40 tempest-VolumesSnapshotsTestJSON-521276636 None] Created reservations ['74d8b5c6-43b0-40a7-beb8-093890936896', '4c136d59-8ae2-4a22-8d81-b2745fa36df1', '47983d53-0fe4-49eb-b4f9-dc3790ba3ce0', '91c26468-d75b-42a5-8872-2e084179431a'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:31:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-3428a2b1-8d2e-492b-b955-42b4e6bfeb08 req-0a7a4598-105d-4729-84d5-1c59754ede40 tempest-VolumesSnapshotsTestJSON-521276636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-3428a2b1-8d2e-492b-b955-42b4e6bfeb08 req-0a7a4598-105d-4729-84d5-1c59754ede40 tempest-VolumesSnapshotsTestJSON-521276636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [req-3428a2b1-8d2e-492b-b955-42b4e6bfeb08 req-0a7a4598-105d-4729-84d5-1c59754ede40 tempest-VolumesSnapshotsTestJSON-521276636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:31:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [req-3428a2b1-8d2e-492b-b955-42b4e6bfeb08 req-0a7a4598-105d-4729-84d5-1c59754ede40 tempest-VolumesSnapshotsTestJSON-521276636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:31:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-3428a2b1-8d2e-492b-b955-42b4e6bfeb08 req-0a7a4598-105d-4729-84d5-1c59754ede40 tempest-VolumesSnapshotsTestJSON-521276636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-3428a2b1-8d2e-492b-b955-42b4e6bfeb08 req-0a7a4598-105d-4729-84d5-1c59754ede40 tempest-VolumesSnapshotsTestJSON-521276636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:23 devstack sudo[88918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:31:23 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:23 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-3428a2b1-8d2e-492b-b955-42b4e6bfeb08 req-0a7a4598-105d-4729-84d5-1c59754ede40 tempest-VolumesSnapshotsTestJSON-521276636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.296s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:23 devstack cinder-volume[87054]: DEBUG cinder.manager [req-3428a2b1-8d2e-492b-b955-42b4e6bfeb08 req-0a7a4598-105d-4729-84d5-1c59754ede40 tempest-VolumesSnapshotsTestJSON-521276636 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:31:23 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-3428a2b1-8d2e-492b-b955-42b4e6bfeb08 req-0a7a4598-105d-4729-84d5-1c59754ede40 tempest-VolumesSnapshotsTestJSON-521276636 None] Deleted volume successfully.
Nov 07 02:31:23 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-3428a2b1-8d2e-492b-b955-42b4e6bfeb08 req-0a7a4598-105d-4729-84d5-1c59754ede40 tempest-VolumesSnapshotsTestJSON-521276636 None] Lock "cinder-ba7d1b04-0b01-4a25-814f-d1b21416ed62-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:31:31 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-57f8c16d-bf92-4cba-80cf-a3ec9c3f66f2 tempest-GroupsTest-1963516840 None] Group tempest-Group1-1413894324: creating
Nov 07 02:31:31 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-57f8c16d-bf92-4cba-80cf-a3ec9c3f66f2 tempest-GroupsTest-1963516840 None] Group tempest-Group1-1413894324: created successfully
Nov 07 02:31:31 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-57f8c16d-bf92-4cba-80cf-a3ec9c3f66f2 tempest-GroupsTest-1963516840 None] Create group completed successfully.
Nov 07 02:31:32 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-faaf240f-ca18-4ad4-979e-2e0999fb30e6 tempest-GroupsTest-1963516840 None] Group tempest-Group2-1433225961: creating
Nov 07 02:31:32 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-faaf240f-ca18-4ad4-979e-2e0999fb30e6 tempest-GroupsTest-1963516840 None] Group tempest-Group2-1433225961: created successfully
Nov 07 02:31:32 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-faaf240f-ca18-4ad4-979e-2e0999fb30e6 tempest-GroupsTest-1963516840 None] Create group completed successfully.
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Flow 'volume_create_manager' (4cc925ad-f201-475d-8bab-5b233de8043e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2805cb05-68b4-4dbe-abc2-2e002e548784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2805cb05-68b4-4dbe-abc2-2e002e548784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1422673991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2f15409a-bb18-41f3-9c6a-2efd34d82dbf,host='devstack@QuobyteHD#QuobyteHD',id=08269c64-2f52-4de7-8ec5-35c153ccd914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dfb3097e03a43108db89a1e7ad1c77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:31:34Z,use_quota=True,user_id='997bcea466d54319a213e526fdefa215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(956009b0-bf7f-4e03-89b2-59952d25f834),volume_type_id=956009b0-bf7f-4e03-89b2-59952d25f834)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79fa0570-7b3c-4db7-8011-619bb5841de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79fa0570-7b3c-4db7-8011-619bb5841de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc761862-acb5-4799-ae1b-47025bbf9168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc761862-acb5-4799-ae1b-47025bbf9168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08269c64-2f52-4de7-8ec5-35c153ccd914', 'volume_name': 'volume-08269c64-2f52-4de7-8ec5-35c153ccd914', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f632bb2-b4d2-4964-bb51-513c279640f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f632bb2-b4d2-4964-bb51-513c279640f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4aafe7-3640-4ca9-aeb9-5a4669e49937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:34 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Volume 08269c64-2f52-4de7-8ec5-35c153ccd914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08269c64-2f52-4de7-8ec5-35c153ccd914', 'volume_size': 1}
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=2f15409a-bb18-41f3-9c6a-2efd34d82dbf,created_at=2026-11-07T01:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1422673991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2f15409a-bb18-41f3-9c6a-2efd34d82dbf,host='devstack@QuobyteHD#QuobyteHD',id=08269c64-2f52-4de7-8ec5-35c153ccd914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dfb3097e03a43108db89a1e7ad1c77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:31:34Z,use_quota=True,user_id='997bcea466d54319a213e526fdefa215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(956009b0-bf7f-4e03-89b2-59952d25f834),volume_type_id=956009b0-bf7f-4e03-89b2-59952d25f834)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Creating volume 08269c64-2f52-4de7-8ec5-35c153ccd914 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:31:34 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08269c64-2f52-4de7-8ec5-35c153ccd914 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:34 devstack sudo[89000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08269c64-2f52-4de7-8ec5-35c153ccd914 1073741824
Nov 07 02:31:34 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:34 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08269c64-2f52-4de7-8ec5-35c153ccd914 1073741824" returned: 0 in 0.509s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08269c64-2f52-4de7-8ec5-35c153ccd914 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:34 devstack sudo[89006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08269c64-2f52-4de7-8ec5-35c153ccd914
Nov 07 02:31:34 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:35 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08269c64-2f52-4de7-8ec5-35c153ccd914" returned: 0 in 0.286s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:31:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4aafe7-3640-4ca9-aeb9-5a4669e49937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08269c64-2f52-4de7-8ec5-35c153ccd914', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cde8205-b75f-4058-93a4-b1b395334b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:35 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Volume volume-08269c64-2f52-4de7-8ec5-35c153ccd914 (08269c64-2f52-4de7-8ec5-35c153ccd914): created successfully
Nov 07 02:31:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cde8205-b75f-4058-93a4-b1b395334b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Flow 'volume_create_manager' (4cc925ad-f201-475d-8bab-5b233de8043e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:31:35 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-6da77fae-f15c-480e-a564-021b04561e59 tempest-GroupsTest-1963516840 None] Created volume successfully.
Nov 07 02:31:38 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2f4ce16a-af37-4a0c-afb5-dfdddcf47bd3 tempest-GroupsTest-1963516840 None] Acquiring lock "cinder-quobyte-08269c64-2f52-4de7-8ec5-35c153ccd914" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:31:38 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2f4ce16a-af37-4a0c-afb5-dfdddcf47bd3 tempest-GroupsTest-1963516840 None] Lock "cinder-quobyte-08269c64-2f52-4de7-8ec5-35c153ccd914" acquired by "delete_volume" :: waited 0.070s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:31:38 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec29e15-dc43-47d2-927e-d5c132b527a1]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:31:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2f4ce16a-af37-4a0c-afb5-dfdddcf47bd3 tempest-GroupsTest-1963516840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08269c64-2f52-4de7-8ec5-35c153ccd914 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:38 devstack sudo[89122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08269c64-2f52-4de7-8ec5-35c153ccd914
Nov 07 02:31:38 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:39 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:UPDATE=53,cinder:SELECT=43,cinder:INSERT=11,cinder:DELETE=4 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:31:39 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2f4ce16a-af37-4a0c-afb5-dfdddcf47bd3 tempest-GroupsTest-1963516840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08269c64-2f52-4de7-8ec5-35c153ccd914" returned: 0 in 1.567s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2f4ce16a-af37-4a0c-afb5-dfdddcf47bd3 tempest-GroupsTest-1963516840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08269c64-2f52-4de7-8ec5-35c153ccd914 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:39 devstack sudo[89164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08269c64-2f52-4de7-8ec5-35c153ccd914
Nov 07 02:31:39 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:40 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2f4ce16a-af37-4a0c-afb5-dfdddcf47bd3 tempest-GroupsTest-1963516840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08269c64-2f52-4de7-8ec5-35c153ccd914" returned: 0 in 0.606s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:40 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2f4ce16a-af37-4a0c-afb5-dfdddcf47bd3 tempest-GroupsTest-1963516840 None] Lock "cinder-quobyte-08269c64-2f52-4de7-8ec5-35c153ccd914" released by "delete_volume" :: held 2.370s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:31:40 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=49,cinder:INSERT=11,cinder:UPDATE=48,cinder:DELETE=5 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:31:40 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-2f4ce16a-af37-4a0c-afb5-dfdddcf47bd3 tempest-GroupsTest-1963516840 None] Created reservations ['30c54e3d-4d64-4d03-84d8-392632627b9c'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:31:40 devstack cinder-volume[87054]: WARNING cinder.quota [None req-2f4ce16a-af37-4a0c-afb5-dfdddcf47bd3 tempest-GroupsTest-1963516840 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-763294256 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-763294256, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:31:40 devstack cinder-volume[87054]: WARNING cinder.quota [None req-2f4ce16a-af37-4a0c-afb5-dfdddcf47bd3 tempest-GroupsTest-1963516840 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-763294256 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-763294256, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:31:40 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-2f4ce16a-af37-4a0c-afb5-dfdddcf47bd3 tempest-GroupsTest-1963516840 None] Created reservations ['3c09b2dd-1371-4638-b0c1-5dbd60cfff3f', '5365072f-5cc4-464b-93ce-dcea41a3607a', '8b9c61f3-5ece-4100-9fcb-c3a1a6f807e8', '6aca2cb3-a850-4587-a227-15af376c09ce'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:31:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2f4ce16a-af37-4a0c-afb5-dfdddcf47bd3 tempest-GroupsTest-1963516840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2f4ce16a-af37-4a0c-afb5-dfdddcf47bd3 tempest-GroupsTest-1963516840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2f4ce16a-af37-4a0c-afb5-dfdddcf47bd3 tempest-GroupsTest-1963516840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:31:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2f4ce16a-af37-4a0c-afb5-dfdddcf47bd3 tempest-GroupsTest-1963516840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:31:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2f4ce16a-af37-4a0c-afb5-dfdddcf47bd3 tempest-GroupsTest-1963516840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2f4ce16a-af37-4a0c-afb5-dfdddcf47bd3 tempest-GroupsTest-1963516840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:41 devstack sudo[89177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:31:41 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:41 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2f4ce16a-af37-4a0c-afb5-dfdddcf47bd3 tempest-GroupsTest-1963516840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.529s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:41 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-2f4ce16a-af37-4a0c-afb5-dfdddcf47bd3 tempest-GroupsTest-1963516840 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:31:41 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-2f4ce16a-af37-4a0c-afb5-dfdddcf47bd3 tempest-GroupsTest-1963516840 None] Delete group completed successfully.
Nov 07 02:31:41 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-853dd474-c252-45be-99dd-6b6f40c83ead tempest-GroupsTest-1963516840 None] Created reservations ['115f67ac-aba4-4ec7-8a0a-cfd66ec5dc59'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:31:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-853dd474-c252-45be-99dd-6b6f40c83ead tempest-GroupsTest-1963516840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-853dd474-c252-45be-99dd-6b6f40c83ead tempest-GroupsTest-1963516840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-853dd474-c252-45be-99dd-6b6f40c83ead tempest-GroupsTest-1963516840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:31:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-853dd474-c252-45be-99dd-6b6f40c83ead tempest-GroupsTest-1963516840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:31:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-853dd474-c252-45be-99dd-6b6f40c83ead tempest-GroupsTest-1963516840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-853dd474-c252-45be-99dd-6b6f40c83ead tempest-GroupsTest-1963516840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:42 devstack sudo[89182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:31:42 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:42 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-853dd474-c252-45be-99dd-6b6f40c83ead tempest-GroupsTest-1963516840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.538s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:42 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-853dd474-c252-45be-99dd-6b6f40c83ead tempest-GroupsTest-1963516840 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:31:42 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-853dd474-c252-45be-99dd-6b6f40c83ead tempest-GroupsTest-1963516840 None] Delete group completed successfully.
Nov 07 02:31:44 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-e4dce233-bc63-4bc8-bcfc-3a0071c4a6fe tempest-GroupsTest-1963516840 None] Group tempest-GroupsTest-Group-211776471: creating
Nov 07 02:31:44 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-e4dce233-bc63-4bc8-bcfc-3a0071c4a6fe tempest-GroupsTest-1963516840 None] Group tempest-GroupsTest-Group-211776471: created successfully
Nov 07 02:31:44 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-e4dce233-bc63-4bc8-bcfc-3a0071c4a6fe tempest-GroupsTest-1963516840 None] Create group completed successfully.
Nov 07 02:31:47 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:31:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Flow 'volume_create_manager' (8022e08d-dd1a-466a-9a1d-45087a38ef9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:31:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e0a6aa-2f70-4688-8747-07e02bc44197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e0a6aa-2f70-4688-8747-07e02bc44197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1733924134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f1f506b-dfd6-4fb0-9ace-26e34ef05196,host='devstack@QuobyteHD#QuobyteHD',id=17d2ef57-ebef-4150-ac0e-a5425a9ffa1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dfb3097e03a43108db89a1e7ad1c77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:31:47Z,use_quota=True,user_id='997bcea466d54319a213e526fdefa215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(131fc1bf-74ce-4bf1-974c-a1cf49723aad),volume_type_id=131fc1bf-74ce-4bf1-974c-a1cf49723aad)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffc285d-6d34-44a4-a0fb-ae4b24f1d085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffc285d-6d34-44a4-a0fb-ae4b24f1d085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64687987-1be7-4421-b5a1-e9fa3105a994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64687987-1be7-4421-b5a1-e9fa3105a994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17d2ef57-ebef-4150-ac0e-a5425a9ffa1b', 'volume_name': 'volume-17d2ef57-ebef-4150-ac0e-a5425a9ffa1b', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52c1e08-e35f-4073-b71c-d10959fa6b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52c1e08-e35f-4073-b71c-d10959fa6b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403ea402-bd29-4868-a7cb-e9c502f29362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:47 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Volume 17d2ef57-ebef-4150-ac0e-a5425a9ffa1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17d2ef57-ebef-4150-ac0e-a5425a9ffa1b', 'volume_size': 1}
Nov 07 02:31:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3f1f506b-dfd6-4fb0-9ace-26e34ef05196,created_at=2026-11-07T01:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1733924134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f1f506b-dfd6-4fb0-9ace-26e34ef05196,host='devstack@QuobyteHD#QuobyteHD',id=17d2ef57-ebef-4150-ac0e-a5425a9ffa1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dfb3097e03a43108db89a1e7ad1c77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:31:47Z,use_quota=True,user_id='997bcea466d54319a213e526fdefa215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(131fc1bf-74ce-4bf1-974c-a1cf49723aad),volume_type_id=131fc1bf-74ce-4bf1-974c-a1cf49723aad)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:31:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Creating volume 17d2ef57-ebef-4150-ac0e-a5425a9ffa1b {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:31:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:31:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:31:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:31:47 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:31:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17d2ef57-ebef-4150-ac0e-a5425a9ffa1b 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:47 devstack sudo[89199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17d2ef57-ebef-4150-ac0e-a5425a9ffa1b 1073741824
Nov 07 02:31:47 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:48 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17d2ef57-ebef-4150-ac0e-a5425a9ffa1b 1073741824" returned: 0 in 1.189s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17d2ef57-ebef-4150-ac0e-a5425a9ffa1b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:48 devstack sudo[89246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17d2ef57-ebef-4150-ac0e-a5425a9ffa1b
Nov 07 02:31:48 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:49 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17d2ef57-ebef-4150-ac0e-a5425a9ffa1b" returned: 0 in 0.791s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:49 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] <== create_volume: return (2050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:31:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.054s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:49 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403ea402-bd29-4868-a7cb-e9c502f29362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d2ef57-ebef-4150-ac0e-a5425a9ffa1b', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:49 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885b86ca-0623-4882-8536-9eed487811ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:49 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Volume volume-17d2ef57-ebef-4150-ac0e-a5425a9ffa1b (17d2ef57-ebef-4150-ac0e-a5425a9ffa1b): created successfully
Nov 07 02:31:49 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885b86ca-0623-4882-8536-9eed487811ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:49 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Flow 'volume_create_manager' (8022e08d-dd1a-466a-9a1d-45087a38ef9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:31:49 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b7acfb53-35c7-4b4a-b310-7b68380bb7fa tempest-GroupsTest-1963516840 None] Created volume successfully.
Nov 07 02:31:52 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:31:52 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Flow 'volume_create_manager' (094e9860-5d65-47dc-882b-f191cc9b4581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:31:52 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a87694e4-e454-4919-ad0a-a3631bfb8955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:52 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a87694e4-e454-4919-ad0a-a3631bfb8955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1003303421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f1f506b-dfd6-4fb0-9ace-26e34ef05196,host='devstack@QuobyteHD#QuobyteHD',id=bd849e57-66d8-4ee1-8c1c-5ba2114340c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dfb3097e03a43108db89a1e7ad1c77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:31:52Z,use_quota=True,user_id='997bcea466d54319a213e526fdefa215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(131fc1bf-74ce-4bf1-974c-a1cf49723aad),volume_type_id=131fc1bf-74ce-4bf1-974c-a1cf49723aad)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:52 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9702170-4f25-414a-b6e4-ef8a12e5a993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:52 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9702170-4f25-414a-b6e4-ef8a12e5a993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:52 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a708a6b-4fc1-4126-a605-0751ee3a20ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:52 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a708a6b-4fc1-4126-a605-0751ee3a20ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd849e57-66d8-4ee1-8c1c-5ba2114340c9', 'volume_name': 'volume-bd849e57-66d8-4ee1-8c1c-5ba2114340c9', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:52 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf2f5ef-de9d-4f7d-9ba3-2231e9ae6649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:52 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf2f5ef-de9d-4f7d-9ba3-2231e9ae6649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:52 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (669ba846-bdc3-4837-a427-4da633752b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:52 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Volume bd849e57-66d8-4ee1-8c1c-5ba2114340c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd849e57-66d8-4ee1-8c1c-5ba2114340c9', 'volume_size': 1}
Nov 07 02:31:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3f1f506b-dfd6-4fb0-9ace-26e34ef05196,created_at=2026-11-07T01:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1003303421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f1f506b-dfd6-4fb0-9ace-26e34ef05196,host='devstack@QuobyteHD#QuobyteHD',id=bd849e57-66d8-4ee1-8c1c-5ba2114340c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dfb3097e03a43108db89a1e7ad1c77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:31:52Z,use_quota=True,user_id='997bcea466d54319a213e526fdefa215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(131fc1bf-74ce-4bf1-974c-a1cf49723aad),volume_type_id=131fc1bf-74ce-4bf1-974c-a1cf49723aad)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:31:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Creating volume bd849e57-66d8-4ee1-8c1c-5ba2114340c9 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:31:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:31:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:31:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:31:52 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:31:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bd849e57-66d8-4ee1-8c1c-5ba2114340c9 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:52 devstack sudo[89284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bd849e57-66d8-4ee1-8c1c-5ba2114340c9 1073741824
Nov 07 02:31:52 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:53 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bd849e57-66d8-4ee1-8c1c-5ba2114340c9 1073741824" returned: 0 in 1.027s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bd849e57-66d8-4ee1-8c1c-5ba2114340c9 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:53 devstack sudo[89289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bd849e57-66d8-4ee1-8c1c-5ba2114340c9
Nov 07 02:31:53 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:54 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bd849e57-66d8-4ee1-8c1c-5ba2114340c9" returned: 0 in 0.553s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (669ba846-bdc3-4837-a427-4da633752b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd849e57-66d8-4ee1-8c1c-5ba2114340c9', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265489d1-8b42-4483-a984-4270467135c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:54 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Volume volume-bd849e57-66d8-4ee1-8c1c-5ba2114340c9 (bd849e57-66d8-4ee1-8c1c-5ba2114340c9): created successfully
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265489d1-8b42-4483-a984-4270467135c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Flow 'volume_create_manager' (094e9860-5d65-47dc-882b-f191cc9b4581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:31:54 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-5ca6eab8-8066-41ca-b147-f1420f2211fe tempest-GroupsTest-1963516840 None] Created volume successfully.
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Flow 'volume_create_manager' (bc39289e-4151-467a-a818-aff2bcf17603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4845aad2-41ca-47db-aa1b-f26b8c955c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4845aad2-41ca-47db-aa1b-f26b8c955c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1004036379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652b6b49-b649-4a7c-b980-93519c4512b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be231888e54c4c64aff1b45d540855ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:31:55Z,use_quota=True,user_id='e1a2f9162dc74bcc9a3c111012a74eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be68c194-cdc2-4435-ba18-f3c6ced5c783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be68c194-cdc2-4435-ba18-f3c6ced5c783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36bbe95d-52fe-4eb5-a940-1223774b10e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36bbe95d-52fe-4eb5-a940-1223774b10e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '652b6b49-b649-4a7c-b980-93519c4512b0', 'volume_name': 'volume-652b6b49-b649-4a7c-b980-93519c4512b0', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6a37d5-97c2-4a4d-b7e4-c8daa8a6ccfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6a37d5-97c2-4a4d-b7e4-c8daa8a6ccfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428df140-e73e-4a71-94d6-15ffb7f87adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:54 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Volume 652b6b49-b649-4a7c-b980-93519c4512b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-652b6b49-b649-4a7c-b980-93519c4512b0', 'volume_size': 1}
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1004036379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652b6b49-b649-4a7c-b980-93519c4512b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be231888e54c4c64aff1b45d540855ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:31:55Z,use_quota=True,user_id='e1a2f9162dc74bcc9a3c111012a74eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Creating volume 652b6b49-b649-4a7c-b980-93519c4512b0 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:31:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:31:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:31:55 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:31:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-652b6b49-b649-4a7c-b980-93519c4512b0 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:55 devstack sudo[89292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-652b6b49-b649-4a7c-b980-93519c4512b0 1073741824
Nov 07 02:31:55 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:55 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-652b6b49-b649-4a7c-b980-93519c4512b0 1073741824" returned: 0 in 0.882s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-652b6b49-b649-4a7c-b980-93519c4512b0 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:56 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-6364c40d-90f2-46e7-a016-03d00a031dbe tempest-GroupsTest-1963516840 None] Update group completed successfully.
Nov 07 02:31:56 devstack sudo[89298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-652b6b49-b649-4a7c-b980-93519c4512b0
Nov 07 02:31:56 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:56 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-652b6b49-b649-4a7c-b980-93519c4512b0" returned: 0 in 0.586s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:56 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:31:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:56 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428df140-e73e-4a71-94d6-15ffb7f87adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-652b6b49-b649-4a7c-b980-93519c4512b0', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:56 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0be5f8-976a-4b7a-8de3-1ebcf522427d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:31:56 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Volume volume-652b6b49-b649-4a7c-b980-93519c4512b0 (652b6b49-b649-4a7c-b980-93519c4512b0): created successfully
Nov 07 02:31:56 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0be5f8-976a-4b7a-8de3-1ebcf522427d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:31:56 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Flow 'volume_create_manager' (bc39289e-4151-467a-a818-aff2bcf17603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:31:56 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c07e1035-514e-4634-bfaa-d31a92aba41d tempest-ServerRescueNegativeTestJSON-835259808 None] Created volume successfully.
Nov 07 02:31:58 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-5c3bed41-5450-4092-90f1-7c113da5bfc0 tempest-GroupsTest-1963516840 None] Update group completed successfully.
Nov 07 02:31:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:31:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:31:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:31:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:31:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:31:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:31:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:31:59 devstack sudo[89338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:31:59 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:31:59 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root
Nov 07 02:31:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.845s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:31:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:31:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:31:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 8 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:31:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>, <Thread(fd_logger, started daemon 125443282798592)>, <Thread(privsep_reader, started daemon 125443284556288)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:32:00 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] Acquiring lock "cinder-quobyte-17d2ef57-ebef-4150-ac0e-a5425a9ffa1b" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:32:00 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] Lock "cinder-quobyte-17d2ef57-ebef-4150-ac0e-a5425a9ffa1b" acquired by "delete_volume" :: waited 0.057s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:32:00 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff45344-8ce0-4111-b3c3-776157d76ec7]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:32:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17d2ef57-ebef-4150-ac0e-a5425a9ffa1b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:00 devstack sudo[89354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17d2ef57-ebef-4150-ac0e-a5425a9ffa1b
Nov 07 02:32:00 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:01 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17d2ef57-ebef-4150-ac0e-a5425a9ffa1b" returned: 0 in 0.972s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17d2ef57-ebef-4150-ac0e-a5425a9ffa1b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:01 devstack sudo[89378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17d2ef57-ebef-4150-ac0e-a5425a9ffa1b
Nov 07 02:32:01 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:02 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17d2ef57-ebef-4150-ac0e-a5425a9ffa1b" returned: 0 in 0.796s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] Lock "cinder-quobyte-17d2ef57-ebef-4150-ac0e-a5425a9ffa1b" released by "delete_volume" :: held 1.927s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:32:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] Acquiring lock "cinder-quobyte-bd849e57-66d8-4ee1-8c1c-5ba2114340c9" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:32:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] Lock "cinder-quobyte-bd849e57-66d8-4ee1-8c1c-5ba2114340c9" acquired by "delete_volume" :: waited 0.043s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:32:02 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b32cbda-5bed-46fb-a027-7f95c7a41e2c]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:32:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bd849e57-66d8-4ee1-8c1c-5ba2114340c9 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:02 devstack sudo[89414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bd849e57-66d8-4ee1-8c1c-5ba2114340c9
Nov 07 02:32:02 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:03 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bd849e57-66d8-4ee1-8c1c-5ba2114340c9" returned: 0 in 0.781s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bd849e57-66d8-4ee1-8c1c-5ba2114340c9 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:03 devstack sudo[89419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bd849e57-66d8-4ee1-8c1c-5ba2114340c9
Nov 07 02:32:03 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:03 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bd849e57-66d8-4ee1-8c1c-5ba2114340c9" returned: 0 in 0.616s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] Lock "cinder-quobyte-bd849e57-66d8-4ee1-8c1c-5ba2114340c9" released by "delete_volume" :: held 1.493s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:32:04 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] Created reservations ['98c22f57-6aaf-4724-aae5-5362cd6a9cdb'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:32:04 devstack cinder-volume[87054]: WARNING cinder.quota [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2035113022 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2035113022, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:32:04 devstack cinder-volume[87054]: WARNING cinder.quota [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2035113022 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2035113022, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:32:04 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] Created reservations ['184280fa-1af9-4e44-b356-81d4098348c8', 'ceeb26b4-3ca9-4dfa-bf21-9035f3a872bb', 'e27b50ca-4209-462e-bf29-857753660a34', '4be2ecdc-1d61-456e-9f63-23c5ddb8d45f'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:32:04 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] Created reservations ['4637a8a7-d3a2-4177-9f2d-dbe7a0cda5d4', '79e8b6ef-3938-42d1-9240-87aadf661a06', '89a7a39a-cc0d-4253-8a37-9662901ebd62', 'a782b3f1-5331-4897-9478-336ba4f2ed67'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:32:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:32:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:32:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:04 devstack sudo[89424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:32:04 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:05 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.399s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:05 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:32:05 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-aa562e33-2946-4d6b-bd78-406b371578ce tempest-GroupsTest-1963516840 None] Delete group completed successfully.
Nov 07 02:32:11 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-15689eb8-bc0e-494e-bbaf-7d166c4f7669 tempest-ServerRescueNegativeTestJSON-835259808 None] Acquiring lock "cinder-652b6b49-b649-4a7c-b980-93519c4512b0-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:32:11 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-15689eb8-bc0e-494e-bbaf-7d166c4f7669 tempest-ServerRescueNegativeTestJSON-835259808 None] Lock "cinder-652b6b49-b649-4a7c-b980-93519c4512b0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:32:11 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-15689eb8-bc0e-494e-bbaf-7d166c4f7669 tempest-ServerRescueNegativeTestJSON-835259808 None] Acquiring lock "cinder-quobyte-652b6b49-b649-4a7c-b980-93519c4512b0" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:32:11 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-15689eb8-bc0e-494e-bbaf-7d166c4f7669 tempest-ServerRescueNegativeTestJSON-835259808 None] Lock "cinder-quobyte-652b6b49-b649-4a7c-b980-93519c4512b0" acquired by "delete_volume" :: waited 0.028s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:32:11 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a33c70-ba3c-4879-96cf-f03b1cb9f5bb]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:32:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-15689eb8-bc0e-494e-bbaf-7d166c4f7669 tempest-ServerRescueNegativeTestJSON-835259808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-652b6b49-b649-4a7c-b980-93519c4512b0 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:12 devstack sudo[89476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-652b6b49-b649-4a7c-b980-93519c4512b0
Nov 07 02:32:12 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:12 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-15689eb8-bc0e-494e-bbaf-7d166c4f7669 tempest-ServerRescueNegativeTestJSON-835259808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-652b6b49-b649-4a7c-b980-93519c4512b0" returned: 0 in 0.697s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-15689eb8-bc0e-494e-bbaf-7d166c4f7669 tempest-ServerRescueNegativeTestJSON-835259808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-652b6b49-b649-4a7c-b980-93519c4512b0 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:12 devstack sudo[89482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-652b6b49-b649-4a7c-b980-93519c4512b0
Nov 07 02:32:12 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:13 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-15689eb8-bc0e-494e-bbaf-7d166c4f7669 tempest-ServerRescueNegativeTestJSON-835259808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-652b6b49-b649-4a7c-b980-93519c4512b0" returned: 0 in 0.452s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:13 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-15689eb8-bc0e-494e-bbaf-7d166c4f7669 tempest-ServerRescueNegativeTestJSON-835259808 None] Lock "cinder-quobyte-652b6b49-b649-4a7c-b980-93519c4512b0" released by "delete_volume" :: held 1.239s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:32:13 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-15689eb8-bc0e-494e-bbaf-7d166c4f7669 tempest-ServerRescueNegativeTestJSON-835259808 None] Created reservations ['35ef3153-9cd0-4556-8ba6-3109ce31854f', 'e350f62e-695b-4026-afdc-d6ccc918707e', 'f8ed1c12-f74d-46a1-b9de-7a38d436ef6f', '5386f566-161f-48a7-95be-349b597ce9be'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:32:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-15689eb8-bc0e-494e-bbaf-7d166c4f7669 tempest-ServerRescueNegativeTestJSON-835259808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-15689eb8-bc0e-494e-bbaf-7d166c4f7669 tempest-ServerRescueNegativeTestJSON-835259808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-15689eb8-bc0e-494e-bbaf-7d166c4f7669 tempest-ServerRescueNegativeTestJSON-835259808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:32:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-15689eb8-bc0e-494e-bbaf-7d166c4f7669 tempest-ServerRescueNegativeTestJSON-835259808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:32:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-15689eb8-bc0e-494e-bbaf-7d166c4f7669 tempest-ServerRescueNegativeTestJSON-835259808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-15689eb8-bc0e-494e-bbaf-7d166c4f7669 tempest-ServerRescueNegativeTestJSON-835259808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:13 devstack sudo[89491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:32:13 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:13 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-15689eb8-bc0e-494e-bbaf-7d166c4f7669 tempest-ServerRescueNegativeTestJSON-835259808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.440s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:13 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-15689eb8-bc0e-494e-bbaf-7d166c4f7669 tempest-ServerRescueNegativeTestJSON-835259808 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:32:13 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-15689eb8-bc0e-494e-bbaf-7d166c4f7669 tempest-ServerRescueNegativeTestJSON-835259808 None] Deleted volume successfully.
Nov 07 02:32:13 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-15689eb8-bc0e-494e-bbaf-7d166c4f7669 tempest-ServerRescueNegativeTestJSON-835259808 None] Lock "cinder-652b6b49-b649-4a7c-b980-93519c4512b0-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:32:23 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=41,cinder:INSERT=6,cinder:UPDATE=57,cinder:DELETE=2 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:32:23 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=43,cinder:UPDATE=45,cinder:INSERT=16,cinder:DELETE=2 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:32:24 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:32:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Flow 'volume_create_manager' (bd827407-aa18-41d3-ace2-3d57a680d816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:32:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624f8f8f-668a-4dce-91aa-88967f488d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624f8f8f-668a-4dce-91aa-88967f488d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-143470163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0d9beba-9581-4799-af92-be4b236a647d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2591d22214a4996bde50c34938b914f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:32:24Z,use_quota=True,user_id='df4bd9146f87441daa963e9ee509d95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86f4630-2c26-4120-9e7c-1369363c772e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86f4630-2c26-4120-9e7c-1369363c772e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b34e4be-f41c-4cf1-b377-d60a30d5f35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b34e4be-f41c-4cf1-b377-d60a30d5f35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0d9beba-9581-4799-af92-be4b236a647d', 'volume_name': 'volume-a0d9beba-9581-4799-af92-be4b236a647d', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee5e9b3-68b7-4259-a2ee-3c37f6103f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee5e9b3-68b7-4259-a2ee-3c37f6103f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5c0d49-526d-4105-bd2a-4f94b4fc6c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:24 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Volume a0d9beba-9581-4799-af92-be4b236a647d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0d9beba-9581-4799-af92-be4b236a647d', 'volume_size': 1}
Nov 07 02:32:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-143470163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0d9beba-9581-4799-af92-be4b236a647d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2591d22214a4996bde50c34938b914f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:32:24Z,use_quota=True,user_id='df4bd9146f87441daa963e9ee509d95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:32:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Creating volume a0d9beba-9581-4799-af92-be4b236a647d {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:32:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:32:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:32:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:32:24 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:32:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a0d9beba-9581-4799-af92-be4b236a647d 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:24 devstack sudo[89559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a0d9beba-9581-4799-af92-be4b236a647d 1073741824
Nov 07 02:32:24 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:25 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a0d9beba-9581-4799-af92-be4b236a647d 1073741824" returned: 0 in 0.607s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a0d9beba-9581-4799-af92-be4b236a647d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:25 devstack sudo[89568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a0d9beba-9581-4799-af92-be4b236a647d
Nov 07 02:32:25 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:25 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a0d9beba-9581-4799-af92-be4b236a647d" returned: 0 in 0.328s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:32:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5c0d49-526d-4105-bd2a-4f94b4fc6c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0d9beba-9581-4799-af92-be4b236a647d', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc95950-ab65-48e4-b91a-94c6177a5976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:25 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Volume volume-a0d9beba-9581-4799-af92-be4b236a647d (a0d9beba-9581-4799-af92-be4b236a647d): created successfully
Nov 07 02:32:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc95950-ab65-48e4-b91a-94c6177a5976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Flow 'volume_create_manager' (bd827407-aa18-41d3-ace2-3d57a680d816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:32:25 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-9e6569eb-fde9-4a22-af1c-47d01cc8ea6d tempest-TaggedAttachmentsTest-1979042444 None] Created volume successfully.
Nov 07 02:32:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-1da04d3a-5de2-492f-8397-e042bfb45053 req-4792d51c-0776-421c-8a34-255c623b13f8 tempest-ServerActionsTestOtherA-715488085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-1da04d3a-5de2-492f-8397-e042bfb45053 req-4792d51c-0776-421c-8a34-255c623b13f8 tempest-ServerActionsTestOtherA-715488085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-1da04d3a-5de2-492f-8397-e042bfb45053 req-4792d51c-0776-421c-8a34-255c623b13f8 tempest-ServerActionsTestOtherA-715488085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-1da04d3a-5de2-492f-8397-e042bfb45053 req-4792d51c-0776-421c-8a34-255c623b13f8 tempest-ServerActionsTestOtherA-715488085 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c', 'name': 'volume-6ee79c99-ae8a-4f68-9c30-057b1e43765b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e999fef7-ac43-40c6-9b20-b9217c6d8e49', 'enforce_multipath': True} {{(pid=87054) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:32:26 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-1da04d3a-5de2-492f-8397-e042bfb45053 req-4792d51c-0776-421c-8a34-255c623b13f8 tempest-ServerActionsTestOtherA-715488085 None] attachment_update completed successfully.
Nov 07 02:32:31 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-6e505eec-29cb-44a4-8865-537d23fcc19e req-8a2035ab-178a-4b42-bf60-d4c551dbf357 tempest-ServerActionsTestOtherA-715488085 None] Terminate volume connection completed successfully.
Nov 07 02:32:31 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-6e505eec-29cb-44a4-8865-537d23fcc19e req-8a2035ab-178a-4b42-bf60-d4c551dbf357 tempest-ServerActionsTestOtherA-715488085 None] Deleting attachment e999fef7-ac43-40c6-9b20-b9217c6d8e49. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:32:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-6e505eec-29cb-44a4-8865-537d23fcc19e req-de873b30-419f-4f7c-99ca-11ecc06be9ab tempest-ServerActionsTestOtherA-715488085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-6e505eec-29cb-44a4-8865-537d23fcc19e req-de873b30-419f-4f7c-99ca-11ecc06be9ab tempest-ServerActionsTestOtherA-715488085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-6e505eec-29cb-44a4-8865-537d23fcc19e req-de873b30-419f-4f7c-99ca-11ecc06be9ab tempest-ServerActionsTestOtherA-715488085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-6e505eec-29cb-44a4-8865-537d23fcc19e req-de873b30-419f-4f7c-99ca-11ecc06be9ab tempest-ServerActionsTestOtherA-715488085 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c', 'name': 'volume-6ee79c99-ae8a-4f68-9c30-057b1e43765b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02bd398f-f528-4159-bf1b-20e3febf7af0', 'enforce_multipath': True} {{(pid=87054) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:32:33 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-6e505eec-29cb-44a4-8865-537d23fcc19e req-de873b30-419f-4f7c-99ca-11ecc06be9ab tempest-ServerActionsTestOtherA-715488085 None] attachment_update completed successfully.
Nov 07 02:32:43 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=14,cinder:UPDATE=4 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:32:43 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=18,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Flow 'volume_create_manager' (b4f47387-4657-47ab-96cc-98f674a4fa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6963ff1e-0894-437d-886c-a62d18354eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6963ff1e-0894-437d-886c-a62d18354eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1437646297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1c1058-34b6-4167-8f87-0282b39ee945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd6aa7aeb324908b85331c35116e1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:32:54Z,use_quota=True,user_id='2bfd488d63a4475292c6f8b02264b8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91cc643a-a8d9-40f5-83df-9366524eca9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91cc643a-a8d9-40f5-83df-9366524eca9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bde5e3c-ac3c-47fb-b31a-5460b15410b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bde5e3c-ac3c-47fb-b31a-5460b15410b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de1c1058-34b6-4167-8f87-0282b39ee945', 'volume_name': 'volume-de1c1058-34b6-4167-8f87-0282b39ee945', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ad761e-1821-44b8-94bd-ee630599b3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ad761e-1821-44b8-94bd-ee630599b3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e597453f-f809-44fd-a27d-588b9ec27897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:54 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Volume de1c1058-34b6-4167-8f87-0282b39ee945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de1c1058-34b6-4167-8f87-0282b39ee945', 'volume_size': 1}
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1437646297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1c1058-34b6-4167-8f87-0282b39ee945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd6aa7aeb324908b85331c35116e1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:32:54Z,use_quota=True,user_id='2bfd488d63a4475292c6f8b02264b8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Creating volume de1c1058-34b6-4167-8f87-0282b39ee945 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:32:54 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:54 devstack sudo[90718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945 1073741824
Nov 07 02:32:54 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:54 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945 1073741824" returned: 0 in 0.537s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:54 devstack sudo[90726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945
Nov 07 02:32:54 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:55 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945" returned: 0 in 0.366s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:32:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e597453f-f809-44fd-a27d-588b9ec27897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de1c1058-34b6-4167-8f87-0282b39ee945', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09121a33-402a-4802-b1d3-5178eb86b6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:32:55 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Volume volume-de1c1058-34b6-4167-8f87-0282b39ee945 (de1c1058-34b6-4167-8f87-0282b39ee945): created successfully
Nov 07 02:32:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09121a33-402a-4802-b1d3-5178eb86b6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:32:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Flow 'volume_create_manager' (b4f47387-4657-47ab-96cc-98f674a4fa96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:32:55 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-646db00f-9d75-4655-be85-0054d2e5d76a tempest-SnapshotMetadataTestJSON-1595116394 None] Created volume successfully.
Nov 07 02:32:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-362fd391-f96e-4117-9ba1-6d3881333466 tempest-SnapshotMetadataTestJSON-1595116394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-362fd391-f96e-4117-9ba1-6d3881333466 tempest-SnapshotMetadataTestJSON-1595116394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:56 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-362fd391-f96e-4117-9ba1-6d3881333466 tempest-SnapshotMetadataTestJSON-1595116394 None] Creating offline snapshot eff264e1-0d4c-40ca-b7a1-9927e276c320 of volume de1c1058-34b6-4167-8f87-0282b39ee945 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:32:56 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f7b8f7-8de1-4557-a14c-f334287e30a2]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:32:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-362fd391-f96e-4117-9ba1-6d3881333466 tempest-SnapshotMetadataTestJSON-1595116394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:56 devstack sudo[90785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945
Nov 07 02:32:56 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:56 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-362fd391-f96e-4117-9ba1-6d3881333466 tempest-SnapshotMetadataTestJSON-1595116394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945" returned: 0 in 0.383s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-362fd391-f96e-4117-9ba1-6d3881333466 tempest-SnapshotMetadataTestJSON-1595116394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.eff264e1-0d4c-40ca-b7a1-9927e276c320 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:56 devstack sudo[90791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.eff264e1-0d4c-40ca-b7a1-9927e276c320 1G
Nov 07 02:32:56 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:57 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-362fd391-f96e-4117-9ba1-6d3881333466 tempest-SnapshotMetadataTestJSON-1595116394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.eff264e1-0d4c-40ca-b7a1-9927e276c320 1G" returned: 0 in 0.429s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-362fd391-f96e-4117-9ba1-6d3881333466 tempest-SnapshotMetadataTestJSON-1595116394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de1c1058-34b6-4167-8f87-0282b39ee945 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.eff264e1-0d4c-40ca-b7a1-9927e276c320 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:57 devstack sudo[90799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de1c1058-34b6-4167-8f87-0282b39ee945 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.eff264e1-0d4c-40ca-b7a1-9927e276c320
Nov 07 02:32:57 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:57 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-362fd391-f96e-4117-9ba1-6d3881333466 tempest-SnapshotMetadataTestJSON-1595116394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de1c1058-34b6-4167-8f87-0282b39ee945 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.eff264e1-0d4c-40ca-b7a1-9927e276c320" returned: 0 in 0.373s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:57 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-362fd391-f96e-4117-9ba1-6d3881333466 tempest-SnapshotMetadataTestJSON-1595116394 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.eff264e1-0d4c-40ca-b7a1-9927e276c320 is being set with open permissions: ugo+rw
Nov 07 02:32:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-362fd391-f96e-4117-9ba1-6d3881333466 tempest-SnapshotMetadataTestJSON-1595116394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.eff264e1-0d4c-40ca-b7a1-9927e276c320 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:57 devstack sudo[90804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.eff264e1-0d4c-40ca-b7a1-9927e276c320
Nov 07 02:32:57 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:58 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-362fd391-f96e-4117-9ba1-6d3881333466 tempest-SnapshotMetadataTestJSON-1595116394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.eff264e1-0d4c-40ca-b7a1-9927e276c320" returned: 0 in 0.494s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-362fd391-f96e-4117-9ba1-6d3881333466 tempest-SnapshotMetadataTestJSON-1595116394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:58 devstack sudo[90850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.info
Nov 07 02:32:58 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:58 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-362fd391-f96e-4117-9ba1-6d3881333466 tempest-SnapshotMetadataTestJSON-1595116394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.info" returned: 0 in 0.584s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:58 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-362fd391-f96e-4117-9ba1-6d3881333466 tempest-SnapshotMetadataTestJSON-1595116394 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.info is being set with open permissions: ugo+rw
Nov 07 02:32:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-362fd391-f96e-4117-9ba1-6d3881333466 tempest-SnapshotMetadataTestJSON-1595116394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:58 devstack sudo[90875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.info
Nov 07 02:32:58 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:59 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-362fd391-f96e-4117-9ba1-6d3881333466 tempest-SnapshotMetadataTestJSON-1595116394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.info" returned: 0 in 0.334s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-362fd391-f96e-4117-9ba1-6d3881333466 tempest-SnapshotMetadataTestJSON-1595116394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.742s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:32:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:32:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:32:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:32:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:32:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:32:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:32:59 devstack sudo[90881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:32:59 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:32:59 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-362fd391-f96e-4117-9ba1-6d3881333466 tempest-SnapshotMetadataTestJSON-1595116394 None] Create snapshot completed successfully
Nov 07 02:32:59 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root
Nov 07 02:32:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.282s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:32:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:33:00 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-745aee9c-d3c8-41a2-a40f-bbc00957129e tempest-SnapshotMetadataTestJSON-1595116394 None] Acquiring lock "cinder-eff264e1-0d4c-40ca-b7a1-9927e276c320-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:00 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-745aee9c-d3c8-41a2-a40f-bbc00957129e tempest-SnapshotMetadataTestJSON-1595116394 None] Lock "cinder-eff264e1-0d4c-40ca-b7a1-9927e276c320-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:00 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-745aee9c-d3c8-41a2-a40f-bbc00957129e tempest-SnapshotMetadataTestJSON-1595116394 None] Acquiring lock "cinder-quobyte-de1c1058-34b6-4167-8f87-0282b39ee945" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:00 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-745aee9c-d3c8-41a2-a40f-bbc00957129e tempest-SnapshotMetadataTestJSON-1595116394 None] Lock "cinder-quobyte-de1c1058-34b6-4167-8f87-0282b39ee945" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:00 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-745aee9c-d3c8-41a2-a40f-bbc00957129e tempest-SnapshotMetadataTestJSON-1595116394 None] Acquiring lock "cinder-quobyte-eff264e1-0d4c-40ca-b7a1-9927e276c320" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:00 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-745aee9c-d3c8-41a2-a40f-bbc00957129e tempest-SnapshotMetadataTestJSON-1595116394 None] Lock "cinder-quobyte-eff264e1-0d4c-40ca-b7a1-9927e276c320" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:00 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-745aee9c-d3c8-41a2-a40f-bbc00957129e tempest-SnapshotMetadataTestJSON-1595116394 None] Deleting offline snapshot eff264e1-0d4c-40ca-b7a1-9927e276c320 of volume de1c1058-34b6-4167-8f87-0282b39ee945 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:33:00 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-745aee9c-d3c8-41a2-a40f-bbc00957129e tempest-SnapshotMetadataTestJSON-1595116394 None] snapshot_file for this snap is: volume-de1c1058-34b6-4167-8f87-0282b39ee945.eff264e1-0d4c-40ca-b7a1-9927e276c320 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:33:00 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ace7ea5-d639-42c0-831b-f04f6764856e]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-745aee9c-d3c8-41a2-a40f-bbc00957129e tempest-SnapshotMetadataTestJSON-1595116394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.eff264e1-0d4c-40ca-b7a1-9927e276c320 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:00 devstack sudo[90888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.eff264e1-0d4c-40ca-b7a1-9927e276c320
Nov 07 02:33:00 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:01 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-745aee9c-d3c8-41a2-a40f-bbc00957129e tempest-SnapshotMetadataTestJSON-1595116394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.eff264e1-0d4c-40ca-b7a1-9927e276c320" returned: 0 in 0.428s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:01 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-745aee9c-d3c8-41a2-a40f-bbc00957129e tempest-SnapshotMetadataTestJSON-1595116394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de1c1058-34b6-4167-8f87-0282b39ee945(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:33:01 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa86bd4-b76f-4395-a71f-8430d6f4d33a]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-745aee9c-d3c8-41a2-a40f-bbc00957129e tempest-SnapshotMetadataTestJSON-1595116394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:01 devstack sudo[90894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945
Nov 07 02:33:01 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:01 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-745aee9c-d3c8-41a2-a40f-bbc00957129e tempest-SnapshotMetadataTestJSON-1595116394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945" returned: 0 in 0.416s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-745aee9c-d3c8-41a2-a40f-bbc00957129e tempest-SnapshotMetadataTestJSON-1595116394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.eff264e1-0d4c-40ca-b7a1-9927e276c320 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:01 devstack sudo[90902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.eff264e1-0d4c-40ca-b7a1-9927e276c320
Nov 07 02:33:01 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:02 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-745aee9c-d3c8-41a2-a40f-bbc00957129e tempest-SnapshotMetadataTestJSON-1595116394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.eff264e1-0d4c-40ca-b7a1-9927e276c320" returned: 0 in 0.385s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-745aee9c-d3c8-41a2-a40f-bbc00957129e tempest-SnapshotMetadataTestJSON-1595116394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.eff264e1-0d4c-40ca-b7a1-9927e276c320 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:02 devstack sudo[90909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.eff264e1-0d4c-40ca-b7a1-9927e276c320
Nov 07 02:33:02 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:02 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-745aee9c-d3c8-41a2-a40f-bbc00957129e tempest-SnapshotMetadataTestJSON-1595116394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945.eff264e1-0d4c-40ca-b7a1-9927e276c320" returned: 0 in 0.300s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-745aee9c-d3c8-41a2-a40f-bbc00957129e tempest-SnapshotMetadataTestJSON-1595116394 None] Lock "cinder-quobyte-eff264e1-0d4c-40ca-b7a1-9927e276c320" released by "_delete_snapshot" :: held 1.711s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-745aee9c-d3c8-41a2-a40f-bbc00957129e tempest-SnapshotMetadataTestJSON-1595116394 None] Lock "cinder-quobyte-de1c1058-34b6-4167-8f87-0282b39ee945" released by "delete_snapshot" :: held 1.747s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:02 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-745aee9c-d3c8-41a2-a40f-bbc00957129e tempest-SnapshotMetadataTestJSON-1595116394 None] Created reservations ['e5e848d4-1e3f-480a-bca9-81118dae72a1', '5f48697c-bce5-4c22-bdc0-0bf0355f509d', '4d7e90f4-00e9-4aab-a35b-db33911a1571', '57fcef7a-fc76-4577-9009-f4f713a9ba49'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:33:02 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-745aee9c-d3c8-41a2-a40f-bbc00957129e tempest-SnapshotMetadataTestJSON-1595116394 None] Delete snapshot completed successfully.
Nov 07 02:33:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-745aee9c-d3c8-41a2-a40f-bbc00957129e tempest-SnapshotMetadataTestJSON-1595116394 None] Lock "cinder-eff264e1-0d4c-40ca-b7a1-9927e276c320-delete_snapshot" released by "delete_snapshot" :: held 1.975s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-717d5263-8247-438d-bf4a-f14cc0ea46a1 tempest-SnapshotMetadataTestJSON-1595116394 None] Acquiring lock "cinder-de1c1058-34b6-4167-8f87-0282b39ee945-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-717d5263-8247-438d-bf4a-f14cc0ea46a1 tempest-SnapshotMetadataTestJSON-1595116394 None] Lock "cinder-de1c1058-34b6-4167-8f87-0282b39ee945-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-717d5263-8247-438d-bf4a-f14cc0ea46a1 tempest-SnapshotMetadataTestJSON-1595116394 None] Acquiring lock "cinder-quobyte-de1c1058-34b6-4167-8f87-0282b39ee945" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-717d5263-8247-438d-bf4a-f14cc0ea46a1 tempest-SnapshotMetadataTestJSON-1595116394 None] Lock "cinder-quobyte-de1c1058-34b6-4167-8f87-0282b39ee945" acquired by "delete_volume" :: waited 0.024s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:03 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6a757a-7487-43a6-968c-6dbd0e6b444f]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-717d5263-8247-438d-bf4a-f14cc0ea46a1 tempest-SnapshotMetadataTestJSON-1595116394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:03 devstack sudo[90913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945
Nov 07 02:33:03 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:03 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-717d5263-8247-438d-bf4a-f14cc0ea46a1 tempest-SnapshotMetadataTestJSON-1595116394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945" returned: 0 in 0.458s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-717d5263-8247-438d-bf4a-f14cc0ea46a1 tempest-SnapshotMetadataTestJSON-1595116394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:03 devstack sudo[90926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945
Nov 07 02:33:03 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:04 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-717d5263-8247-438d-bf4a-f14cc0ea46a1 tempest-SnapshotMetadataTestJSON-1595116394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-de1c1058-34b6-4167-8f87-0282b39ee945" returned: 0 in 0.521s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-717d5263-8247-438d-bf4a-f14cc0ea46a1 tempest-SnapshotMetadataTestJSON-1595116394 None] Lock "cinder-quobyte-de1c1058-34b6-4167-8f87-0282b39ee945" released by "delete_volume" :: held 1.069s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:04 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-717d5263-8247-438d-bf4a-f14cc0ea46a1 tempest-SnapshotMetadataTestJSON-1595116394 None] Created reservations ['ba691a54-9ff0-47e4-9712-264132be52a4', '8b08856d-7539-40b9-8c12-50b11ae48fc3', 'c8412ffa-da0d-4c10-a47c-a87d6335638e', '97573e79-92bf-48ac-894d-2723a5737ff3'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:33:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-717d5263-8247-438d-bf4a-f14cc0ea46a1 tempest-SnapshotMetadataTestJSON-1595116394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-717d5263-8247-438d-bf4a-f14cc0ea46a1 tempest-SnapshotMetadataTestJSON-1595116394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-717d5263-8247-438d-bf4a-f14cc0ea46a1 tempest-SnapshotMetadataTestJSON-1595116394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:33:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-717d5263-8247-438d-bf4a-f14cc0ea46a1 tempest-SnapshotMetadataTestJSON-1595116394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:33:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-717d5263-8247-438d-bf4a-f14cc0ea46a1 tempest-SnapshotMetadataTestJSON-1595116394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-717d5263-8247-438d-bf4a-f14cc0ea46a1 tempest-SnapshotMetadataTestJSON-1595116394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:04 devstack sudo[90938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:33:04 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:05 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-717d5263-8247-438d-bf4a-f14cc0ea46a1 tempest-SnapshotMetadataTestJSON-1595116394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.607s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:05 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-717d5263-8247-438d-bf4a-f14cc0ea46a1 tempest-SnapshotMetadataTestJSON-1595116394 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:33:05 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-717d5263-8247-438d-bf4a-f14cc0ea46a1 tempest-SnapshotMetadataTestJSON-1595116394 None] Deleted volume successfully.
Nov 07 02:33:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-717d5263-8247-438d-bf4a-f14cc0ea46a1 tempest-SnapshotMetadataTestJSON-1595116394 None] Lock "cinder-de1c1058-34b6-4167-8f87-0282b39ee945-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:05 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-04473902-ff2d-4f4e-b386-06a768ca009a req-d9f98f2c-6854-492a-a214-0a76a38fb647 tempest-ServerActionsTestOtherA-715488085 None] Terminate volume connection completed successfully.
Nov 07 02:33:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-04473902-ff2d-4f4e-b386-06a768ca009a req-d9f98f2c-6854-492a-a214-0a76a38fb647 tempest-ServerActionsTestOtherA-715488085 None] Deleting attachment 02bd398f-f528-4159-bf1b-20e3febf7af0. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:33:15 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=14,cinder:INSERT=5,cinder:UPDATE=19,cinder:DELETE=3 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:33:15 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:UPDATE=17,cinder:SELECT=20,cinder:INSERT=5 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:33:18 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:33:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Flow 'volume_create_manager' (8e9d2581-8b3e-4993-8f11-db74cbbb071c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:33:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3158022-59b1-4779-a3bc-1bf7bf0d2917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3158022-59b1-4779-a3bc-1bf7bf0d2917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1402410103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce23fa767b241528aa76f1dfc112efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:33:18Z,use_quota=True,user_id='5f7f037ad61d4f44927aed2fa7040452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9084e38e-4822-4375-87d4-470ac344297f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9084e38e-4822-4375-87d4-470ac344297f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e13643-a20a-4756-aa59-3d1cc7484406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:18 devstack cinder-volume[87054]: DEBUG cinder.image.glance [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Creating Keystone auth plugin from conf {{(pid=87054) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Flow 'volume_create_manager' (0ac48b1a-ff3d-440c-af67-c83432b24ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8cc9e36-c3e4-43cc-850e-b7c27863ecdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8cc9e36-c3e4-43cc-850e-b7c27863ecdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1078842166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2cda644-2830-4fa1-beef-fe76df65b9aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2394aa6dda1e4c3cb65b42518f8a08a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:33:19Z,use_quota=True,user_id='375422ff6bfa4ea5ae8e6231e939d85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08329adf-61ff-4bce-9a29-cfc25f461ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08329adf-61ff-4bce-9a29-cfc25f461ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52715658-8d9b-4230-8422-f810947d1b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52715658-8d9b-4230-8422-f810947d1b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2cda644-2830-4fa1-beef-fe76df65b9aa', 'volume_name': 'volume-d2cda644-2830-4fa1-beef-fe76df65b9aa', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10b08dc-ee29-48be-8f8b-1cf407aec1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10b08dc-ee29-48be-8f8b-1cf407aec1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc3290e-8bd3-477a-8246-d5f1fb946aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:19 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Volume d2cda644-2830-4fa1-beef-fe76df65b9aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2cda644-2830-4fa1-beef-fe76df65b9aa', 'volume_size': 1}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1078842166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2cda644-2830-4fa1-beef-fe76df65b9aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2394aa6dda1e4c3cb65b42518f8a08a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:33:19Z,use_quota=True,user_id='375422ff6bfa4ea5ae8e6231e939d85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Creating volume d2cda644-2830-4fa1-beef-fe76df65b9aa {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:33:19 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d2cda644-2830-4fa1-beef-fe76df65b9aa 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:19 devstack sudo[91140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d2cda644-2830-4fa1-beef-fe76df65b9aa 1073741824
Nov 07 02:33:19 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e13643-a20a-4756-aa59-3d1cc7484406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb', 'volume_name': 'volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb', 'volume_size': 1, 'image_id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567ec8d3497e4e06904abb9c1c036004', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 25, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72170a4e0ec0>}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adac5e21-836b-4f8c-bc44-d309d7ed752b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adac5e21-836b-4f8c-bc44-d309d7ed752b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff37852-7575-4273-b81b-2c3a4fd6f5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:19 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Volume b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb', 'volume_size': 1, 'image_id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567ec8d3497e4e06904abb9c1c036004', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 25, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72170a4e0ec0>}
Nov 07 02:33:19 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Trying to clone b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb from image b7a104a5-0b13-4f47-bea7-fab65f1346d5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}]). {{(pid=87054) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-041cd775-e9ad-4936-9d39-c7a44fe7ac49 req-33ed31be-cede-4b14-9b00-9137de6e9005 tempest-TaggedAttachmentsTest-1979042444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:20 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d2cda644-2830-4fa1-beef-fe76df65b9aa 1073741824" returned: 0 in 0.779s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d2cda644-2830-4fa1-beef-fe76df65b9aa {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:20 devstack sudo[91177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d2cda644-2830-4fa1-beef-fe76df65b9aa
Nov 07 02:33:20 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_bd0xnmrxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 07 02:33:20 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Image download 20.69 MB at 20.69 MB/s
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb6b46d-54c5-469c-9922-e4a4cc196954]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_bd0xnmrxdevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:20 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d2cda644-2830-4fa1-beef-fe76df65b9aa" returned: 0 in 0.452s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-041cd775-e9ad-4936-9d39-c7a44fe7ac49 req-33ed31be-cede-4b14-9b00-9137de6e9005 tempest-TaggedAttachmentsTest-1979042444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.683s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-041cd775-e9ad-4936-9d39-c7a44fe7ac49 req-33ed31be-cede-4b14-9b00-9137de6e9005 tempest-TaggedAttachmentsTest-1979042444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc3290e-8bd3-477a-8246-d5f1fb946aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2cda644-2830-4fa1-beef-fe76df65b9aa', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8ac954-da8e-41ba-bc32-3d0e01ef6ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:20 devstack sudo[91181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_bd0xnmrxdevstack@QuobyteHD
Nov 07 02:33:20 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:20 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Volume volume-d2cda644-2830-4fa1-beef-fe76df65b9aa (d2cda644-2830-4fa1-beef-fe76df65b9aa): created successfully
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8ac954-da8e-41ba-bc32-3d0e01ef6ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Flow 'volume_create_manager' (0ac48b1a-ff3d-440c-af67-c83432b24ac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-041cd775-e9ad-4936-9d39-c7a44fe7ac49 req-33ed31be-cede-4b14-9b00-9137de6e9005 tempest-TaggedAttachmentsTest-1979042444 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c', 'name': 'volume-a0d9beba-9581-4799-af92-be4b236a647d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75a5df75-152f-4d04-b81a-b3e3b2375b03', 'enforce_multipath': True} {{(pid=87054) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:33:20 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-157167c5-e077-4ebf-a9a9-5ee6eb313d90 tempest-ServersNegativeTestJSON-2098778434 None] Created volume successfully.
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Flow 'volume_create_manager' (4a9bf516-d627-440e-b6e1-5f822651fe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a1da1b-adc8-46f0-aab7-a146d528bce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a1da1b-adc8-46f0-aab7-a146d528bce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-769864554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=024894dc-db12-43a0-a67f-fadca45e3aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68fc4e28dcb34395954b908a61261987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:33:21Z,use_quota=True,user_id='50ae0145d637407997a3160364506220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037b8589-a85d-4c0e-b372-ae7c84694c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037b8589-a85d-4c0e-b372-ae7c84694c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2bfcf3-c920-4e2c-8741-270f048fbeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2bfcf3-c920-4e2c-8741-270f048fbeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '024894dc-db12-43a0-a67f-fadca45e3aa4', 'volume_name': 'volume-024894dc-db12-43a0-a67f-fadca45e3aa4', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:21 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbac04a3-cf92-4bef-91b3-958cc039a306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:21 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbac04a3-cf92-4bef-91b3-958cc039a306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:21 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61897f50-ffc9-44f3-aff1-891440aef211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:21 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Volume 024894dc-db12-43a0-a67f-fadca45e3aa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-024894dc-db12-43a0-a67f-fadca45e3aa4', 'volume_size': 1}
Nov 07 02:33:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:21 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-769864554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=024894dc-db12-43a0-a67f-fadca45e3aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68fc4e28dcb34395954b908a61261987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:33:21Z,use_quota=True,user_id='50ae0145d637407997a3160364506220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:33:21 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Creating volume 024894dc-db12-43a0-a67f-fadca45e3aa4 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:33:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:21 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:33:21 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:33:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:21 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:33:21 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:33:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:21 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_bd0xnmrxdevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:21 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Temporary image b7a104a5-0b13-4f47-bea7-fab65f1346d5 is fetched for user 5f7f037ad61d4f44927aed2fa7040452. {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 07 02:33:21 devstack sudo[91187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4 1073741824
Nov 07 02:33:21 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:21 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-041cd775-e9ad-4936-9d39-c7a44fe7ac49 req-33ed31be-cede-4b14-9b00-9137de6e9005 tempest-TaggedAttachmentsTest-1979042444 None] attachment_update completed successfully.
Nov 07 02:33:21 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9bb5f8-ad7d-40a9-8f6c-d05086c30f51]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_bd0xnmrxdevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:21 devstack sudo[91190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_bd0xnmrxdevstack@QuobyteHD
Nov 07 02:33:21 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:21 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_bd0xnmrxdevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:21 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4 1073741824" returned: 0 in 0.679s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:21 devstack sudo[91614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4
Nov 07 02:33:21 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:22 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4" returned: 0 in 0.338s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:22 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:33:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.487s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:22 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1402410103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce23fa767b241528aa76f1dfc112efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:33:18Z,use_quota=True,user_id='5f7f037ad61d4f44927aed2fa7040452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:33:22 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Creating volume b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:33:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:22 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:33:22 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:33:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:22 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:33:22 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:33:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:22 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61897f50-ffc9-44f3-aff1-891440aef211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-024894dc-db12-43a0-a67f-fadca45e3aa4', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:22 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f8e810-b7a8-45c7-a22b-374ca0059f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:22 devstack sudo[91617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb 1073741824
Nov 07 02:33:22 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:22 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Volume volume-024894dc-db12-43a0-a67f-fadca45e3aa4 (024894dc-db12-43a0-a67f-fadca45e3aa4): created successfully
Nov 07 02:33:22 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f8e810-b7a8-45c7-a22b-374ca0059f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:22 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Flow 'volume_create_manager' (4a9bf516-d627-440e-b6e1-5f822651fe41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:33:22 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-56bdf6c0-060c-41c8-b2c5-612c20acf191 tempest-VolumesDeleteCascade-969973790 None] Created volume successfully.
Nov 07 02:33:22 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb 1073741824" returned: 0 in 0.552s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:22 devstack sudo[91623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb
Nov 07 02:33:22 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:23 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb" returned: 0 in 0.300s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Attempting download of b7a104a5-0b13-4f47-bea7-fab65f1346d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}])) to volume b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb. {{(pid=87054) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[2389cd02-1ec5-4e74-b660-56ad31ddc8f7]: (4, 'raw') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_cx1ey_uq {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Flow 'volume_create_manager' (16c45ea6-511b-4c74-a7fb-c65b3017f504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bfd334f-8791-441b-bd98-466e29ab6cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:23 devstack sudo[91627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_cx1ey_uq
Nov 07 02:33:23 devstack sudo[91627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bfd334f-8791-441b-bd98-466e29ab6cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1745751476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae640dd6-a1c6-43c6-94ca-2e54d533d68e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2394aa6dda1e4c3cb65b42518f8a08a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:33:23Z,use_quota=True,user_id='375422ff6bfa4ea5ae8e6231e939d85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f7b6ab-18f4-47b4-8649-3fc41434b45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f7b6ab-18f4-47b4-8649-3fc41434b45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25de24d-80c1-4033-87c8-eb6e7e8e80fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25de24d-80c1-4033-87c8-eb6e7e8e80fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae640dd6-a1c6-43c6-94ca-2e54d533d68e', 'volume_name': 'volume-ae640dd6-a1c6-43c6-94ca-2e54d533d68e', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5995a06-d29d-4e47-b911-907df07e3b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5995a06-d29d-4e47-b911-907df07e3b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c462c012-cdda-41f2-a045-78a6515312cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:23 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Volume ae640dd6-a1c6-43c6-94ca-2e54d533d68e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae640dd6-a1c6-43c6-94ca-2e54d533d68e', 'volume_size': 1}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1745751476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae640dd6-a1c6-43c6-94ca-2e54d533d68e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2394aa6dda1e4c3cb65b42518f8a08a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:33:23Z,use_quota=True,user_id='375422ff6bfa4ea5ae8e6231e939d85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Creating volume ae640dd6-a1c6-43c6-94ca-2e54d533d68e {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:33:23 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae640dd6-a1c6-43c6-94ca-2e54d533d68e 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-381ebc84-6dc6-4bb8-8df5-5bb95bb84ab9 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:23 devstack sudo[91633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae640dd6-a1c6-43c6-94ca-2e54d533d68e 1073741824
Nov 07 02:33:23 devstack sudo[91633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:23 devstack sudo[91627]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_cx1ey_uq" returned: 0 in 0.362s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_cx1ey_uq {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:23 devstack sudo[91637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_cx1ey_uq
Nov 07 02:33:23 devstack sudo[91637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:23 devstack sudo[91633]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae640dd6-a1c6-43c6-94ca-2e54d533d68e 1073741824" returned: 0 in 0.492s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae640dd6-a1c6-43c6-94ca-2e54d533d68e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:23 devstack sudo[91637]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_cx1ey_uq" returned: 1 in 0.385s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_cx1ey_uq' failed. Not Retrying. {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f972f0b-0049-460d-919b-ba24d95d7ca9]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_bd0xnmrxdevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:23 devstack sudo[91646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae640dd6-a1c6-43c6-94ca-2e54d533d68e
Nov 07 02:33:23 devstack sudo[91646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:23 devstack sudo[91648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_bd0xnmrxdevstack@QuobyteHD
Nov 07 02:33:23 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:24 devstack sudo[91646]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae640dd6-a1c6-43c6-94ca-2e54d533d68e" returned: 0 in 0.284s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:33:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-381ebc84-6dc6-4bb8-8df5-5bb95bb84ab9 tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.814s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-381ebc84-6dc6-4bb8-8df5-5bb95bb84ab9 tempest-VolumesDeleteCascade-969973790 None] Creating offline snapshot 48594460-421e-4fea-b8de-b77796f9b2f8 of volume 024894dc-db12-43a0-a67f-fadca45e3aa4 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:33:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c462c012-cdda-41f2-a045-78a6515312cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae640dd6-a1c6-43c6-94ca-2e54d533d68e', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b2e6a4-92dc-432d-9530-112ecf638b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:24 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[692fd59e-ee9d-495c-a2f5-9711f01bf258]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-381ebc84-6dc6-4bb8-8df5-5bb95bb84ab9 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:24 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Volume volume-ae640dd6-a1c6-43c6-94ca-2e54d533d68e (ae640dd6-a1c6-43c6-94ca-2e54d533d68e): created successfully
Nov 07 02:33:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b2e6a4-92dc-432d-9530-112ecf638b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Flow 'volume_create_manager' (16c45ea6-511b-4c74-a7fb-c65b3017f504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:33:24 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-e709799b-d212-478b-b0aa-f90dcd2683bd tempest-ServersNegativeTestJSON-2098778434 None] Created volume successfully.
Nov 07 02:33:24 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_bd0xnmrxdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:24 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] b7a104a5-0b13-4f47-bea7-fab65f1346d5 was qcow2, converting to qcow2 {{(pid=87054) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 07 02:33:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_bd0xnmrxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:24 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-c88e8de9-d250-4395-99cb-360476f270e9 req-79eb0fd5-2587-43fa-8316-3f96be883537 tempest-TaggedAttachmentsTest-1979042444 None] Terminate volume connection completed successfully.
Nov 07 02:33:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-c88e8de9-d250-4395-99cb-360476f270e9 req-79eb0fd5-2587-43fa-8316-3f96be883537 tempest-TaggedAttachmentsTest-1979042444 None] Deleting attachment 75a5df75-152f-4d04-b81a-b3e3b2375b03. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:33:24 devstack sudo[91682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_bd0xnmrxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb
Nov 07 02:33:24 devstack sudo[91682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:24 devstack sudo[91652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4
Nov 07 02:33:24 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:24 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-381ebc84-6dc6-4bb8-8df5-5bb95bb84ab9 tempest-VolumesDeleteCascade-969973790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4" returned: 0 in 0.426s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-381ebc84-6dc6-4bb8-8df5-5bb95bb84ab9 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:24 devstack sudo[91692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8 1G
Nov 07 02:33:24 devstack sudo[91692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:25 devstack sudo[91692]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-381ebc84-6dc6-4bb8-8df5-5bb95bb84ab9 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8 1G" returned: 0 in 0.450s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-381ebc84-6dc6-4bb8-8df5-5bb95bb84ab9 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-024894dc-db12-43a0-a67f-fadca45e3aa4 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:25 devstack sudo[91706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-024894dc-db12-43a0-a67f-fadca45e3aa4 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8
Nov 07 02:33:25 devstack sudo[91706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:25 devstack sudo[91706]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-381ebc84-6dc6-4bb8-8df5-5bb95bb84ab9 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-024894dc-db12-43a0-a67f-fadca45e3aa4 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8" returned: 0 in 0.726s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:25 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-381ebc84-6dc6-4bb8-8df5-5bb95bb84ab9 tempest-VolumesDeleteCascade-969973790 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8 is being set with open permissions: ugo+rw
Nov 07 02:33:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-381ebc84-6dc6-4bb8-8df5-5bb95bb84ab9 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:25 devstack sudo[91724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8
Nov 07 02:33:25 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a0b89e40-45ff-4e08-91a4-02c05a07b87c tempest-ServersNegativeTestJSON-2098778434 None] Acquiring lock "cinder-ae640dd6-a1c6-43c6-94ca-2e54d533d68e-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a0b89e40-45ff-4e08-91a4-02c05a07b87c tempest-ServersNegativeTestJSON-2098778434 None] Lock "cinder-ae640dd6-a1c6-43c6-94ca-2e54d533d68e-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a0b89e40-45ff-4e08-91a4-02c05a07b87c tempest-ServersNegativeTestJSON-2098778434 None] Acquiring lock "cinder-quobyte-ae640dd6-a1c6-43c6-94ca-2e54d533d68e" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a0b89e40-45ff-4e08-91a4-02c05a07b87c tempest-ServersNegativeTestJSON-2098778434 None] Lock "cinder-quobyte-ae640dd6-a1c6-43c6-94ca-2e54d533d68e" acquired by "delete_volume" :: waited 0.032s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:26 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ec16b0-bae4-495b-8582-3ae998fe70fb]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a0b89e40-45ff-4e08-91a4-02c05a07b87c tempest-ServersNegativeTestJSON-2098778434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae640dd6-a1c6-43c6-94ca-2e54d533d68e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:26 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-381ebc84-6dc6-4bb8-8df5-5bb95bb84ab9 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8" returned: 0 in 0.484s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-381ebc84-6dc6-4bb8-8df5-5bb95bb84ab9 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:26 devstack sudo[91733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.info
Nov 07 02:33:26 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:26 devstack sudo[91732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae640dd6-a1c6-43c6-94ca-2e54d533d68e
Nov 07 02:33:26 devstack sudo[91732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:26 devstack sudo[91732]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:26 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-381ebc84-6dc6-4bb8-8df5-5bb95bb84ab9 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.info" returned: 0 in 0.439s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:26 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-381ebc84-6dc6-4bb8-8df5-5bb95bb84ab9 tempest-VolumesDeleteCascade-969973790 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.info is being set with open permissions: ugo+rw
Nov 07 02:33:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-381ebc84-6dc6-4bb8-8df5-5bb95bb84ab9 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a0b89e40-45ff-4e08-91a4-02c05a07b87c tempest-ServersNegativeTestJSON-2098778434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae640dd6-a1c6-43c6-94ca-2e54d533d68e" returned: 0 in 0.549s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a0b89e40-45ff-4e08-91a4-02c05a07b87c tempest-ServersNegativeTestJSON-2098778434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae640dd6-a1c6-43c6-94ca-2e54d533d68e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:26 devstack sudo[91743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.info
Nov 07 02:33:26 devstack sudo[91743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:26 devstack sudo[91744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae640dd6-a1c6-43c6-94ca-2e54d533d68e
Nov 07 02:33:26 devstack sudo[91744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:27 devstack sudo[91682]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_bd0xnmrxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb" returned: 0 in 2.747s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_bd0xnmrxdevstack@QuobyteHD, size 112.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:33:27 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Converted 112.00 MB image at 40.76 MB/s
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:27 devstack sudo[91748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb 1G
Nov 07 02:33:27 devstack sudo[91748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:27 devstack sudo[91743]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a0b89e40-45ff-4e08-91a4-02c05a07b87c tempest-ServersNegativeTestJSON-2098778434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae640dd6-a1c6-43c6-94ca-2e54d533d68e" returned: 0 in 0.353s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-381ebc84-6dc6-4bb8-8df5-5bb95bb84ab9 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.info" returned: 0 in 0.374s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-381ebc84-6dc6-4bb8-8df5-5bb95bb84ab9 tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.075s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:27 devstack sudo[91744]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a0b89e40-45ff-4e08-91a4-02c05a07b87c tempest-ServersNegativeTestJSON-2098778434 None] Lock "cinder-quobyte-ae640dd6-a1c6-43c6-94ca-2e54d533d68e" released by "delete_volume" :: held 1.059s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:27 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-381ebc84-6dc6-4bb8-8df5-5bb95bb84ab9 tempest-VolumesDeleteCascade-969973790 None] Create snapshot completed successfully
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-a0b89e40-45ff-4e08-91a4-02c05a07b87c tempest-ServersNegativeTestJSON-2098778434 None] Created reservations ['aabf3a76-298e-4662-8549-b4cfdee4b04b', '69ace1b9-82bf-4372-82ad-4988097d3a51', '572cbf99-8a8e-4895-825a-187e4e4ad901', 'b5fedc61-00d3-42c5-bff9-563596822235'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a0b89e40-45ff-4e08-91a4-02c05a07b87c tempest-ServersNegativeTestJSON-2098778434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a0b89e40-45ff-4e08-91a4-02c05a07b87c tempest-ServersNegativeTestJSON-2098778434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a0b89e40-45ff-4e08-91a4-02c05a07b87c tempest-ServersNegativeTestJSON-2098778434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a0b89e40-45ff-4e08-91a4-02c05a07b87c tempest-ServersNegativeTestJSON-2098778434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a0b89e40-45ff-4e08-91a4-02c05a07b87c tempest-ServersNegativeTestJSON-2098778434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a0b89e40-45ff-4e08-91a4-02c05a07b87c tempest-ServersNegativeTestJSON-2098778434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:27 devstack sudo[91757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:33:27 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:27 devstack sudo[91748]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb 1G" returned: 0 in 0.507s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Downloaded image b7a104a5-0b13-4f47-bea7-fab65f1346d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}])) to volume b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb successfully. {{(pid=87054) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Temporary image b7a104a5-0b13-4f47-bea7-fab65f1346d5 for user 5f7f037ad61d4f44927aed2fa7040452 is deleted. {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Marking volume b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb as bootable. {{(pid=87054) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Copying metadata from image b7a104a5-0b13-4f47-bea7-fab65f1346d5 to b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb. {{(pid=87054) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Creating volume glance metadata for volume b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb backed by image b7a104a5-0b13-4f47-bea7-fab65f1346d5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87054) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff37852-7575-4273-b81b-2c3a4fd6f5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb', 'volume_size': 1, 'image_id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567ec8d3497e4e06904abb9c1c036004', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 25, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72170a4e0ec0>}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8d8194-5008-46b1-9cdd-76b9fb19005f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:27 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Volume volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb (b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb): created successfully
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8d8194-5008-46b1-9cdd-76b9fb19005f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Flow 'volume_create_manager' (8e9d2581-8b3e-4993-8f11-db74cbbb071c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:33:27 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-da3936e1-3380-45c1-a6f4-17a555004190 tempest-ServerActionsTestOtherA-715488085 None] Created volume successfully.
Nov 07 02:33:27 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a0b89e40-45ff-4e08-91a4-02c05a07b87c tempest-ServersNegativeTestJSON-2098778434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.310s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-a0b89e40-45ff-4e08-91a4-02c05a07b87c tempest-ServersNegativeTestJSON-2098778434 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:33:27 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-a0b89e40-45ff-4e08-91a4-02c05a07b87c tempest-ServersNegativeTestJSON-2098778434 None] Deleted volume successfully.
Nov 07 02:33:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a0b89e40-45ff-4e08-91a4-02c05a07b87c tempest-ServersNegativeTestJSON-2098778434 None] Lock "cinder-ae640dd6-a1c6-43c6-94ca-2e54d533d68e-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6214c21b-b57d-4abb-b1ad-06498b9be294 tempest-ServersNegativeTestJSON-2098778434 None] Acquiring lock "cinder-d2cda644-2830-4fa1-beef-fe76df65b9aa-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6214c21b-b57d-4abb-b1ad-06498b9be294 tempest-ServersNegativeTestJSON-2098778434 None] Lock "cinder-d2cda644-2830-4fa1-beef-fe76df65b9aa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6214c21b-b57d-4abb-b1ad-06498b9be294 tempest-ServersNegativeTestJSON-2098778434 None] Acquiring lock "cinder-quobyte-d2cda644-2830-4fa1-beef-fe76df65b9aa" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6214c21b-b57d-4abb-b1ad-06498b9be294 tempest-ServersNegativeTestJSON-2098778434 None] Lock "cinder-quobyte-d2cda644-2830-4fa1-beef-fe76df65b9aa" acquired by "delete_volume" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:28 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6541ccc-933d-4754-bce6-b8744839a26c]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6214c21b-b57d-4abb-b1ad-06498b9be294 tempest-ServersNegativeTestJSON-2098778434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d2cda644-2830-4fa1-beef-fe76df65b9aa {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:28 devstack sudo[91761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d2cda644-2830-4fa1-beef-fe76df65b9aa
Nov 07 02:33:28 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-4b95ae2f-be2f-4c81-95da-c4887bd87fa3 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-4b95ae2f-be2f-4c81-95da-c4887bd87fa3 tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-4b95ae2f-be2f-4c81-95da-c4887bd87fa3 tempest-VolumesDeleteCascade-969973790 None] Creating offline snapshot 24025d5f-e500-40a0-8f80-297bdf4286df of volume 024894dc-db12-43a0-a67f-fadca45e3aa4 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:33:28 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[56edbb78-b2a5-4e6a-8cf5-2e9187caba16]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4b95ae2f-be2f-4c81-95da-c4887bd87fa3 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:28 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6214c21b-b57d-4abb-b1ad-06498b9be294 tempest-ServersNegativeTestJSON-2098778434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d2cda644-2830-4fa1-beef-fe76df65b9aa" returned: 0 in 0.526s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6214c21b-b57d-4abb-b1ad-06498b9be294 tempest-ServersNegativeTestJSON-2098778434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d2cda644-2830-4fa1-beef-fe76df65b9aa {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:28 devstack sudo[91763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8
Nov 07 02:33:28 devstack sudo[91763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:28 devstack sudo[91767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d2cda644-2830-4fa1-beef-fe76df65b9aa
Nov 07 02:33:28 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:29 devstack sudo[91763]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4b95ae2f-be2f-4c81-95da-c4887bd87fa3 tempest-VolumesDeleteCascade-969973790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8" returned: 0 in 0.501s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-4b95ae2f-be2f-4c81-95da-c4887bd87fa3 tempest-VolumesDeleteCascade-969973790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-024894dc-db12-43a0-a67f-fadca45e3aa4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:33:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4b95ae2f-be2f-4c81-95da-c4887bd87fa3 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.24025d5f-e500-40a0-8f80-297bdf4286df 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:29 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6214c21b-b57d-4abb-b1ad-06498b9be294 tempest-ServersNegativeTestJSON-2098778434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d2cda644-2830-4fa1-beef-fe76df65b9aa" returned: 0 in 0.381s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:29 devstack sudo[91776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.24025d5f-e500-40a0-8f80-297bdf4286df 1G
Nov 07 02:33:29 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:29 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6214c21b-b57d-4abb-b1ad-06498b9be294 tempest-ServersNegativeTestJSON-2098778434 None] Lock "cinder-quobyte-d2cda644-2830-4fa1-beef-fe76df65b9aa" released by "delete_volume" :: held 0.979s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:29 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-6214c21b-b57d-4abb-b1ad-06498b9be294 tempest-ServersNegativeTestJSON-2098778434 None] Created reservations ['b1aa537d-e102-4148-86b3-518e0cf06014', 'f6a71c44-c236-459d-8517-6913c3aa0564', '898123e9-4d6d-4e65-80cb-58170e269b25', '0a036051-5d42-473e-afc7-3c25217986e6'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:33:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6214c21b-b57d-4abb-b1ad-06498b9be294 tempest-ServersNegativeTestJSON-2098778434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6214c21b-b57d-4abb-b1ad-06498b9be294 tempest-ServersNegativeTestJSON-2098778434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6214c21b-b57d-4abb-b1ad-06498b9be294 tempest-ServersNegativeTestJSON-2098778434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:33:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6214c21b-b57d-4abb-b1ad-06498b9be294 tempest-ServersNegativeTestJSON-2098778434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:33:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6214c21b-b57d-4abb-b1ad-06498b9be294 tempest-ServersNegativeTestJSON-2098778434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6214c21b-b57d-4abb-b1ad-06498b9be294 tempest-ServersNegativeTestJSON-2098778434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:29 devstack sudo[91795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:33:29 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:30 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4b95ae2f-be2f-4c81-95da-c4887bd87fa3 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.24025d5f-e500-40a0-8f80-297bdf4286df 1G" returned: 0 in 0.907s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4b95ae2f-be2f-4c81-95da-c4887bd87fa3 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.24025d5f-e500-40a0-8f80-297bdf4286df {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:30 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6214c21b-b57d-4abb-b1ad-06498b9be294 tempest-ServersNegativeTestJSON-2098778434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.518s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:30 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6214c21b-b57d-4abb-b1ad-06498b9be294 tempest-ServersNegativeTestJSON-2098778434 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:33:30 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-6214c21b-b57d-4abb-b1ad-06498b9be294 tempest-ServersNegativeTestJSON-2098778434 None] Deleted volume successfully.
Nov 07 02:33:30 devstack sudo[91809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.24025d5f-e500-40a0-8f80-297bdf4286df
Nov 07 02:33:30 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:30 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6214c21b-b57d-4abb-b1ad-06498b9be294 tempest-ServersNegativeTestJSON-2098778434 None] Lock "cinder-d2cda644-2830-4fa1-beef-fe76df65b9aa-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:30 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4b95ae2f-be2f-4c81-95da-c4887bd87fa3 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.24025d5f-e500-40a0-8f80-297bdf4286df" returned: 0 in 0.395s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:30 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-4b95ae2f-be2f-4c81-95da-c4887bd87fa3 tempest-VolumesDeleteCascade-969973790 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.24025d5f-e500-40a0-8f80-297bdf4286df is being set with open permissions: ugo+rw
Nov 07 02:33:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4b95ae2f-be2f-4c81-95da-c4887bd87fa3 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.24025d5f-e500-40a0-8f80-297bdf4286df {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:30 devstack sudo[91817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.24025d5f-e500-40a0-8f80-297bdf4286df
Nov 07 02:33:30 devstack sudo[91817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:30 devstack sudo[91817]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4b95ae2f-be2f-4c81-95da-c4887bd87fa3 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.24025d5f-e500-40a0-8f80-297bdf4286df" returned: 0 in 0.301s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-4b95ae2f-be2f-4c81-95da-c4887bd87fa3 tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.246s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:30 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-4b95ae2f-be2f-4c81-95da-c4887bd87fa3 tempest-VolumesDeleteCascade-969973790 None] Create snapshot completed successfully
Nov 07 02:33:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "cinder-024894dc-db12-43a0-a67f-fadca45e3aa4-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-024894dc-db12-43a0-a67f-fadca45e3aa4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Performing cascade delete. {{(pid=87054) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 07 02:33:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "cinder-24025d5f-e500-40a0-8f80-297bdf4286df-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-24025d5f-e500-40a0-8f80-297bdf4286df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "cinder-quobyte-024894dc-db12-43a0-a67f-fadca45e3aa4" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-quobyte-024894dc-db12-43a0-a67f-fadca45e3aa4" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "cinder-quobyte-24025d5f-e500-40a0-8f80-297bdf4286df" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-quobyte-24025d5f-e500-40a0-8f80-297bdf4286df" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:32 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Deleting offline snapshot 24025d5f-e500-40a0-8f80-297bdf4286df of volume 024894dc-db12-43a0-a67f-fadca45e3aa4 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:33:32 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] snapshot_file for this snap is: volume-024894dc-db12-43a0-a67f-fadca45e3aa4.24025d5f-e500-40a0-8f80-297bdf4286df {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:33:32 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[9943faf2-0cf6-4a8f-87e0-b31ff6cf02b6]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.24025d5f-e500-40a0-8f80-297bdf4286df {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-f4916a4e-f069-410d-96b2-a753bc31de52 req-89a85358-9cd2-4d9d-b3ca-fd2d53abe695 tempest-ServerActionsTestOtherA-715488085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-f4916a4e-f069-410d-96b2-a753bc31de52 req-89a85358-9cd2-4d9d-b3ca-fd2d53abe695 tempest-ServerActionsTestOtherA-715488085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-f4916a4e-f069-410d-96b2-a753bc31de52 req-89a85358-9cd2-4d9d-b3ca-fd2d53abe695 tempest-ServerActionsTestOtherA-715488085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-f4916a4e-f069-410d-96b2-a753bc31de52 req-89a85358-9cd2-4d9d-b3ca-fd2d53abe695 tempest-ServerActionsTestOtherA-715488085 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c', 'name': 'volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24772d21-fb5b-498a-b0f5-1fc0b7cfdf81', 'enforce_multipath': True} {{(pid=87054) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:33:32 devstack sudo[91852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.24025d5f-e500-40a0-8f80-297bdf4286df
Nov 07 02:33:32 devstack sudo[91852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:32 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-f4916a4e-f069-410d-96b2-a753bc31de52 req-89a85358-9cd2-4d9d-b3ca-fd2d53abe695 tempest-ServerActionsTestOtherA-715488085 None] attachment_update completed successfully.
Nov 07 02:33:33 devstack sudo[91852]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.24025d5f-e500-40a0-8f80-297bdf4286df" returned: 0 in 0.668s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-024894dc-db12-43a0-a67f-fadca45e3aa4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:33:33 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[8558128b-0e59-4224-8154-bb8086128416]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:33 devstack sudo[91860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8
Nov 07 02:33:33 devstack sudo[91860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:33 devstack sudo[91860]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8" returned: 0 in 0.565s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-024894dc-db12-43a0-a67f-fadca45e3aa4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:33:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.24025d5f-e500-40a0-8f80-297bdf4286df {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:33 devstack sudo[91866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.24025d5f-e500-40a0-8f80-297bdf4286df
Nov 07 02:33:33 devstack sudo[91866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:34 devstack sudo[91866]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.24025d5f-e500-40a0-8f80-297bdf4286df" returned: 0 in 0.493s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.24025d5f-e500-40a0-8f80-297bdf4286df {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:34 devstack sudo[91872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.24025d5f-e500-40a0-8f80-297bdf4286df
Nov 07 02:33:34 devstack sudo[91872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:34 devstack sudo[91872]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.24025d5f-e500-40a0-8f80-297bdf4286df" returned: 0 in 0.340s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-quobyte-24025d5f-e500-40a0-8f80-297bdf4286df" released by "_delete_snapshot" :: held 2.228s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-quobyte-024894dc-db12-43a0-a67f-fadca45e3aa4" released by "delete_snapshot" :: held 2.288s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:34 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Created reservations ['d2997b9a-d4bb-4db4-a321-4c31b2f82d4d', '805d0c4b-bd17-428c-bf47-902506a151a4', '9c71b5cb-05a7-4b3e-836d-938da73a2844', '485147c3-1aeb-4a74-b47e-c02fb67819f5'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:33:34 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Delete snapshot completed successfully.
Nov 07 02:33:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-24025d5f-e500-40a0-8f80-297bdf4286df-delete_snapshot" released by "delete_snapshot" :: held 2.504s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "cinder-48594460-421e-4fea-b8de-b77796f9b2f8-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-48594460-421e-4fea-b8de-b77796f9b2f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "cinder-quobyte-024894dc-db12-43a0-a67f-fadca45e3aa4" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-quobyte-024894dc-db12-43a0-a67f-fadca45e3aa4" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "cinder-quobyte-48594460-421e-4fea-b8de-b77796f9b2f8" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-quobyte-48594460-421e-4fea-b8de-b77796f9b2f8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Deleting offline snapshot 48594460-421e-4fea-b8de-b77796f9b2f8 of volume 024894dc-db12-43a0-a67f-fadca45e3aa4 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:33:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] snapshot_file for this snap is: volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:33:34 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[3050356f-6f55-4e9f-a419-3d165f87e155]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:34 devstack sudo[91877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8
Nov 07 02:33:34 devstack sudo[91877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:35 devstack sudo[91877]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8" returned: 0 in 0.447s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-024894dc-db12-43a0-a67f-fadca45e3aa4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:33:35 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d7cc69-5833-4f85-a3d2-e994e20eaeda]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:35 devstack sudo[91883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4
Nov 07 02:33:35 devstack sudo[91883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:35 devstack sudo[91883]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4" returned: 0 in 0.462s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:35 devstack sudo[91890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8
Nov 07 02:33:35 devstack sudo[91890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:36 devstack sudo[91890]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-82460c54-82ea-45d7-a9d7-c79f3c543bb3 tempest-TaggedAttachmentsTest-1979042444 None] Acquiring lock "cinder-a0d9beba-9581-4799-af92-be4b236a647d-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8" returned: 0 in 0.591s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-82460c54-82ea-45d7-a9d7-c79f3c543bb3 tempest-TaggedAttachmentsTest-1979042444 None] Lock "cinder-a0d9beba-9581-4799-af92-be4b236a647d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:36 devstack sudo[91908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8
Nov 07 02:33:36 devstack sudo[91908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-82460c54-82ea-45d7-a9d7-c79f3c543bb3 tempest-TaggedAttachmentsTest-1979042444 None] Acquiring lock "cinder-quobyte-a0d9beba-9581-4799-af92-be4b236a647d" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-82460c54-82ea-45d7-a9d7-c79f3c543bb3 tempest-TaggedAttachmentsTest-1979042444 None] Lock "cinder-quobyte-a0d9beba-9581-4799-af92-be4b236a647d" acquired by "delete_volume" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:36 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f112a7-2def-47d0-8c78-2fea2c5f9344]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-82460c54-82ea-45d7-a9d7-c79f3c543bb3 tempest-TaggedAttachmentsTest-1979042444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a0d9beba-9581-4799-af92-be4b236a647d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:36 devstack sudo[91910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a0d9beba-9581-4799-af92-be4b236a647d
Nov 07 02:33:36 devstack sudo[91910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:36 devstack sudo[91908]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4.48594460-421e-4fea-b8de-b77796f9b2f8" returned: 0 in 0.441s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-quobyte-48594460-421e-4fea-b8de-b77796f9b2f8" released by "_delete_snapshot" :: held 2.070s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-quobyte-024894dc-db12-43a0-a67f-fadca45e3aa4" released by "delete_snapshot" :: held 2.104s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:36 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Created reservations ['901a21ff-477b-4ba6-9bf6-b3e89a270722', 'cbf93621-77be-4924-a537-767de28cec68', '62127eef-d516-47eb-868d-c4571f6e09ef', 'afe8343f-0db1-4731-94ea-bbf7be915ccd'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:33:37 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Delete snapshot completed successfully.
Nov 07 02:33:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-48594460-421e-4fea-b8de-b77796f9b2f8-delete_snapshot" released by "delete_snapshot" :: held 2.323s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:37 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Snapshots deleted, issuing volume delete {{(pid=87054) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 07 02:33:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "cinder-quobyte-024894dc-db12-43a0-a67f-fadca45e3aa4" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-quobyte-024894dc-db12-43a0-a67f-fadca45e3aa4" acquired by "delete_volume" :: waited 0.021s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:37 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1718a58-75d3-4551-8554-7709f7f6ff14]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:37 devstack sudo[91910]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-82460c54-82ea-45d7-a9d7-c79f3c543bb3 tempest-TaggedAttachmentsTest-1979042444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a0d9beba-9581-4799-af92-be4b236a647d" returned: 0 in 0.578s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-82460c54-82ea-45d7-a9d7-c79f3c543bb3 tempest-TaggedAttachmentsTest-1979042444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a0d9beba-9581-4799-af92-be4b236a647d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:37 devstack sudo[92019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a0d9beba-9581-4799-af92-be4b236a647d
Nov 07 02:33:37 devstack sudo[92019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:37 devstack sudo[92018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4
Nov 07 02:33:37 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:37 devstack sudo[92019]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-82460c54-82ea-45d7-a9d7-c79f3c543bb3 tempest-TaggedAttachmentsTest-1979042444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a0d9beba-9581-4799-af92-be4b236a647d" returned: 0 in 0.513s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-82460c54-82ea-45d7-a9d7-c79f3c543bb3 tempest-TaggedAttachmentsTest-1979042444 None] Lock "cinder-quobyte-a0d9beba-9581-4799-af92-be4b236a647d" released by "delete_volume" :: held 1.197s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:37 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-82460c54-82ea-45d7-a9d7-c79f3c543bb3 tempest-TaggedAttachmentsTest-1979042444 None] Created reservations ['6388c627-16fa-4574-afd0-5940b82c5953', '00b3de6e-b738-4fd7-bee9-58ed08125ce3', '92a4617b-2d07-4396-af3e-da5cb045f5b5', 'd1e89805-7314-4aab-9bbb-4436dea981a2'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:33:37 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4" returned: 0 in 0.738s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:37 devstack sudo[92366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4
Nov 07 02:33:37 devstack sudo[92366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-82460c54-82ea-45d7-a9d7-c79f3c543bb3 tempest-TaggedAttachmentsTest-1979042444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-82460c54-82ea-45d7-a9d7-c79f3c543bb3 tempest-TaggedAttachmentsTest-1979042444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:37 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-82460c54-82ea-45d7-a9d7-c79f3c543bb3 tempest-TaggedAttachmentsTest-1979042444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:33:37 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-82460c54-82ea-45d7-a9d7-c79f3c543bb3 tempest-TaggedAttachmentsTest-1979042444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:33:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-82460c54-82ea-45d7-a9d7-c79f3c543bb3 tempest-TaggedAttachmentsTest-1979042444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-82460c54-82ea-45d7-a9d7-c79f3c543bb3 tempest-TaggedAttachmentsTest-1979042444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:38 devstack sudo[92371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:33:38 devstack sudo[92371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:38 devstack sudo[92366]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-024894dc-db12-43a0-a67f-fadca45e3aa4" returned: 0 in 0.319s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:38 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-quobyte-024894dc-db12-43a0-a67f-fadca45e3aa4" released by "delete_volume" :: held 1.151s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:38 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Created reservations ['982785e2-cdc9-471d-922f-16380fdfa7fd', 'db4a5afa-15e3-4777-966a-bc6452ba3410', 'cb385868-6246-4331-8c52-a23681a5fd81', 'e10d829c-b72a-4e45-8c57-be69ae908eb2'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:33:38 devstack sudo[92371]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-82460c54-82ea-45d7-a9d7-c79f3c543bb3 tempest-TaggedAttachmentsTest-1979042444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.357s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:38 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-82460c54-82ea-45d7-a9d7-c79f3c543bb3 tempest-TaggedAttachmentsTest-1979042444 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:33:38 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-82460c54-82ea-45d7-a9d7-c79f3c543bb3 tempest-TaggedAttachmentsTest-1979042444 None] Deleted volume successfully.
Nov 07 02:33:38 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-82460c54-82ea-45d7-a9d7-c79f3c543bb3 tempest-TaggedAttachmentsTest-1979042444 None] Lock "cinder-a0d9beba-9581-4799-af92-be4b236a647d-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:33:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:33:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:38 devstack sudo[92381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:33:38 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:38 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.355s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:38 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:33:38 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Deleted volume successfully.
Nov 07 02:33:38 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ead788d5-a6e9-46ac-ba65-c3b87a235cd9 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-024894dc-db12-43a0-a67f-fadca45e3aa4-delete_volume" released by "delete_volume" :: held 6.718s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:33:40 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:33:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Flow 'volume_create_manager' (65015e96-a8d8-4ea1-8914-7173840f1905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:33:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd2d3fe-25d9-4091-a80b-06863b33d7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd2d3fe-25d9-4091-a80b-06863b33d7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1752444894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7644bc5e-c753-424e-ae3b-f8d9ede7e51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68fc4e28dcb34395954b908a61261987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:33:40Z,use_quota=True,user_id='50ae0145d637407997a3160364506220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb6646c-c1a5-47d7-ae4e-1dcb13facef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb6646c-c1a5-47d7-ae4e-1dcb13facef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c8723c-5f27-4996-8964-5e28de78f653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c8723c-5f27-4996-8964-5e28de78f653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7644bc5e-c753-424e-ae3b-f8d9ede7e51a', 'volume_name': 'volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446a4346-96fe-4984-8256-6668d84d544c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446a4346-96fe-4984-8256-6668d84d544c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41814645-7c03-4f93-b389-212284f38843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:40 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Volume 7644bc5e-c753-424e-ae3b-f8d9ede7e51a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a', 'volume_size': 1}
Nov 07 02:33:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1752444894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7644bc5e-c753-424e-ae3b-f8d9ede7e51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68fc4e28dcb34395954b908a61261987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:33:40Z,use_quota=True,user_id='50ae0145d637407997a3160364506220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:33:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Creating volume 7644bc5e-c753-424e-ae3b-f8d9ede7e51a {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:33:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:33:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:33:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:33:40 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:33:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:40 devstack sudo[92391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a 1073741824
Nov 07 02:33:40 devstack sudo[92391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:41 devstack sudo[92391]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a 1073741824" returned: 0 in 0.789s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:41 devstack sudo[92399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a
Nov 07 02:33:41 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:41 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a" returned: 0 in 0.343s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:33:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:41 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41814645-7c03-4f93-b389-212284f38843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:41 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1891b538-b849-4e41-8522-0fe7c8efb01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:41 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Volume volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a (7644bc5e-c753-424e-ae3b-f8d9ede7e51a): created successfully
Nov 07 02:33:41 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1891b538-b849-4e41-8522-0fe7c8efb01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:41 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Flow 'volume_create_manager' (65015e96-a8d8-4ea1-8914-7173840f1905) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:33:41 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-10c9fd40-d293-42c8-bd5e-c310c85c8e2e tempest-VolumesDeleteCascade-969973790 None] Created volume successfully.
Nov 07 02:33:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b0904800-a925-42c8-886c-16d3d192e2c9 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b0904800-a925-42c8-886c-16d3d192e2c9 tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:42 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-b0904800-a925-42c8-886c-16d3d192e2c9 tempest-VolumesDeleteCascade-969973790 None] Creating offline snapshot 5b882e90-b5a3-45ff-be0f-b8eeff1883b5 of volume 7644bc5e-c753-424e-ae3b-f8d9ede7e51a {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:33:42 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c23d110-778e-4f68-a3ac-efaf17aa02d3]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b0904800-a925-42c8-886c-16d3d192e2c9 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:42 devstack sudo[92404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a
Nov 07 02:33:42 devstack sudo[92404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:43 devstack sudo[92404]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b0904800-a925-42c8-886c-16d3d192e2c9 tempest-VolumesDeleteCascade-969973790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a" returned: 0 in 0.718s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b0904800-a925-42c8-886c-16d3d192e2c9 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.5b882e90-b5a3-45ff-be0f-b8eeff1883b5 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:43 devstack sudo[92410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.5b882e90-b5a3-45ff-be0f-b8eeff1883b5 1G
Nov 07 02:33:43 devstack sudo[92410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:43 devstack sudo[92410]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b0904800-a925-42c8-886c-16d3d192e2c9 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.5b882e90-b5a3-45ff-be0f-b8eeff1883b5 1G" returned: 0 in 0.624s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b0904800-a925-42c8-886c-16d3d192e2c9 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.5b882e90-b5a3-45ff-be0f-b8eeff1883b5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:43 devstack sudo[92417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.5b882e90-b5a3-45ff-be0f-b8eeff1883b5
Nov 07 02:33:43 devstack sudo[92417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:44 devstack sudo[92417]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b0904800-a925-42c8-886c-16d3d192e2c9 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.5b882e90-b5a3-45ff-be0f-b8eeff1883b5" returned: 0 in 0.376s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:44 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-b0904800-a925-42c8-886c-16d3d192e2c9 tempest-VolumesDeleteCascade-969973790 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.5b882e90-b5a3-45ff-be0f-b8eeff1883b5 is being set with open permissions: ugo+rw
Nov 07 02:33:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b0904800-a925-42c8-886c-16d3d192e2c9 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.5b882e90-b5a3-45ff-be0f-b8eeff1883b5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:44 devstack sudo[92423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.5b882e90-b5a3-45ff-be0f-b8eeff1883b5
Nov 07 02:33:44 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:44 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b0904800-a925-42c8-886c-16d3d192e2c9 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.5b882e90-b5a3-45ff-be0f-b8eeff1883b5" returned: 0 in 0.481s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b0904800-a925-42c8-886c-16d3d192e2c9 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:44 devstack sudo[92426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.info
Nov 07 02:33:44 devstack sudo[92426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:45 devstack sudo[92426]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b0904800-a925-42c8-886c-16d3d192e2c9 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.info" returned: 0 in 0.513s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:45 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-b0904800-a925-42c8-886c-16d3d192e2c9 tempest-VolumesDeleteCascade-969973790 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.info is being set with open permissions: ugo+rw
Nov 07 02:33:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b0904800-a925-42c8-886c-16d3d192e2c9 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:45 devstack sudo[92431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.info
Nov 07 02:33:45 devstack sudo[92431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:45 devstack sudo[92431]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b0904800-a925-42c8-886c-16d3d192e2c9 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.info" returned: 0 in 0.421s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b0904800-a925-42c8-886c-16d3d192e2c9 tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.293s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:45 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b0904800-a925-42c8-886c-16d3d192e2c9 tempest-VolumesDeleteCascade-969973790 None] Create snapshot completed successfully
Nov 07 02:33:47 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:33:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Flow 'volume_create_manager' (7c856329-4096-4217-8308-2c195968951a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:33:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63996c6f-4e1c-4a26-8d69-454b06ed0edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63996c6f-4e1c-4a26-8d69-454b06ed0edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-211855690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bcd6ac3-e80f-47c5-907e-764bcda67983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68fc4e28dcb34395954b908a61261987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5b882e90-b5a3-45ff-be0f-b8eeff1883b5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:33:48Z,use_quota=True,user_id='50ae0145d637407997a3160364506220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce289a90-8cb7-4a34-9b8c-ba556006541c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce289a90-8cb7-4a34-9b8c-ba556006541c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cfa90ad-17a9-475d-9488-d3707c8475a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cfa90ad-17a9-475d-9488-d3707c8475a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2bcd6ac3-e80f-47c5-907e-764bcda67983', 'volume_name': 'volume-2bcd6ac3-e80f-47c5-907e-764bcda67983', 'volume_size': 1, 'snapshot_id': '5b882e90-b5a3-45ff-be0f-b8eeff1883b5'}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e30dda7e-f2b7-4f29-831b-be32744cda7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e30dda7e-f2b7-4f29-831b-be32744cda7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b66397-ce2a-41e8-b5e3-dcc6ad170ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:33:48 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Volume 2bcd6ac3-e80f-47c5-907e-764bcda67983: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2bcd6ac3-e80f-47c5-907e-764bcda67983', 'volume_size': 1, 'snapshot_id': '5b882e90-b5a3-45ff-be0f-b8eeff1883b5'}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "cinder-quobyte-5b882e90-b5a3-45ff-be0f-b8eeff1883b5-2bcd6ac3-e80f-47c5-907e-764bcda67983" by "_create_volume_from_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-quobyte-5b882e90-b5a3-45ff-be0f-b8eeff1883b5-2bcd6ac3-e80f-47c5-907e-764bcda67983" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Creating volume 2bcd6ac3-e80f-47c5-907e-764bcda67983 from snapshot 5b882e90-b5a3-45ff-be0f-b8eeff1883b5 {{(pid=87054) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "cinder-quobyte-2bcd6ac3-e80f-47c5-907e-764bcda67983" by "_copy_volume_from_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-quobyte-2bcd6ac3-e80f-47c5-907e-764bcda67983" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] snapshot: 5b882e90-b5a3-45ff-be0f-b8eeff1883b5, volume: 2bcd6ac3-e80f-47c5-907e-764bcda67983,  {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[9672efed-ed1d-4dfa-b7b9-a3025274f2f3]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.5b882e90-b5a3-45ff-be0f-b8eeff1883b5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:48 devstack sudo[92441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.5b882e90-b5a3-45ff-be0f-b8eeff1883b5
Nov 07 02:33:48 devstack sudo[92441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:48 devstack sudo[92441]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.5b882e90-b5a3-45ff-be0f-b8eeff1883b5" returned: 0 in 0.495s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[1958453b-6b57-4664-8018-a8f9688897d2]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:33:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:48 devstack sudo[92446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a
Nov 07 02:33:48 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:49 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a" returned: 0 in 0.594s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:49 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:33:49 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Creating direct copy from snapshot {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:33:49 devstack cinder-volume[87054]: DEBUG cinder.utils [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Path /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2bcd6ac3-e80f-47c5-907e-764bcda67983 not found in is_blk_device check {{(pid=87054) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:33:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2bcd6ac3-e80f-47c5-907e-764bcda67983 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:49 devstack sudo[92452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2bcd6ac3-e80f-47c5-907e-764bcda67983
Nov 07 02:33:49 devstack sudo[92452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:57 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=72,cinder:UPDATE=64,cinder:INSERT=20,cinder:DELETE=4 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:33:58 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=76,cinder:INSERT=24,cinder:UPDATE=71,cinder:DELETE=8 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:33:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:33:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:33:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:33:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:33:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:33:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:33:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:33:59 devstack sudo[92556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:33:59 devstack sudo[92556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:33:59 devstack sudo[92556]: pam_unix(sudo:session): session closed for user root
Nov 07 02:33:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.428s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:33:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:33:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:33:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 28 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:33:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>, <Thread(fd_logger, started daemon 125443282798592)>, <Thread(privsep_reader, started daemon 125443284556288)>, <Thread(tpool_thread_0, started daemon 125443276445376)>, <Thread(tpool_thread_1, started daemon 125443268036288)>, <Thread(tpool_thread_2, started daemon 125443259627200)>, <Thread(tpool_thread_3, started daemon 125443251218112)>, <Thread(tpool_thread_4, started daemon 125443242809024)>, <Thread(tpool_thread_5, started daemon 125443234399936)>, <Thread(tpool_thread_6, started daemon 125443225990848)>, <Thread(tpool_thread_7, started daemon 125443217581760)>, <Thread(tpool_thread_8, started daemon 125443209172672)>, <Thread(tpool_thread_9, started daemon 125443200763584)>, <Thread(tpool_thread_10, started daemon 125443192354496)>, <Thread(tpool_thread_11, started daemon 125443183945408)>, <Thread(tpool_thread_12, started daemon 125443175536320)>, <Thread(tpool_thread_13, started daemon 125443167127232)>, <Thread(tpool_thread_14, started daemon 125443158718144)>, <Thread(tpool_thread_15, started daemon 125443150309056)>, <Thread(tpool_thread_16, started daemon 125443141899968)>, <Thread(tpool_thread_17, started daemon 125443133490880)>, <Thread(tpool_thread_18, started daemon 125443125081792)>, <Thread(tpool_thread_19, started daemon 125443116672704)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:34:00 devstack sudo[92452]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2bcd6ac3-e80f-47c5-907e-764bcda67983" returned: 0 in 11.276s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:00 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Image conversion details: src /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a, size 1024.00 MB, duration 11.28 sec, destination /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2bcd6ac3-e80f-47c5-907e-764bcda67983 {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:34:00 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Converted 1024.00 MB image at 90.80 MB/s
Nov 07 02:34:00 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2bcd6ac3-e80f-47c5-907e-764bcda67983 is being set with open permissions: ugo+rw
Nov 07 02:34:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2bcd6ac3-e80f-47c5-907e-764bcda67983 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:00 devstack sudo[92560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2bcd6ac3-e80f-47c5-907e-764bcda67983
Nov 07 02:34:00 devstack sudo[92560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:00 devstack sudo[92560]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2bcd6ac3-e80f-47c5-907e-764bcda67983" returned: 0 in 0.306s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:00 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-quobyte-2bcd6ac3-e80f-47c5-907e-764bcda67983" released by "_copy_volume_from_snapshot" :: held 12.822s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-quobyte-5b882e90-b5a3-45ff-be0f-b8eeff1883b5-2bcd6ac3-e80f-47c5-907e-764bcda67983" released by "_create_volume_from_snapshot" :: held 12.930s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.959s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:01 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b66397-ce2a-41e8-b5e3-dcc6ad170ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bcd6ac3-e80f-47c5-907e-764bcda67983', 'volume_size': 1, 'snapshot_id': '5b882e90-b5a3-45ff-be0f-b8eeff1883b5'}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:01 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07aa8aa-ab33-4b5d-a729-e66b6c24913c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:01 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Volume volume-2bcd6ac3-e80f-47c5-907e-764bcda67983 (2bcd6ac3-e80f-47c5-907e-764bcda67983): created successfully
Nov 07 02:34:01 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07aa8aa-ab33-4b5d-a729-e66b6c24913c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:01 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Flow 'volume_create_manager' (7c856329-4096-4217-8308-2c195968951a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:01 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-da71efa0-3d6f-465b-9d88-004a6f456586 tempest-VolumesDeleteCascade-969973790 None] Created volume successfully.
Nov 07 02:34:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "cinder-7644bc5e-c753-424e-ae3b-f8d9ede7e51a-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-7644bc5e-c753-424e-ae3b-f8d9ede7e51a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:01 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Performing cascade delete. {{(pid=87054) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 07 02:34:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "cinder-5b882e90-b5a3-45ff-be0f-b8eeff1883b5-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-5b882e90-b5a3-45ff-be0f-b8eeff1883b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "cinder-quobyte-7644bc5e-c753-424e-ae3b-f8d9ede7e51a" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-quobyte-7644bc5e-c753-424e-ae3b-f8d9ede7e51a" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "cinder-quobyte-5b882e90-b5a3-45ff-be0f-b8eeff1883b5" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-quobyte-5b882e90-b5a3-45ff-be0f-b8eeff1883b5" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:01 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Deleting offline snapshot 5b882e90-b5a3-45ff-be0f-b8eeff1883b5 of volume 7644bc5e-c753-424e-ae3b-f8d9ede7e51a {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:34:01 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] snapshot_file for this snap is: volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.5b882e90-b5a3-45ff-be0f-b8eeff1883b5 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:34:02 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[06645eff-b4ab-4a88-94cc-c8eac6dd735e]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.5b882e90-b5a3-45ff-be0f-b8eeff1883b5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:02 devstack sudo[92581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.5b882e90-b5a3-45ff-be0f-b8eeff1883b5
Nov 07 02:34:02 devstack sudo[92581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:02 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-1db5b6fc-979f-4d3b-bd56-7f27165ee087 req-ea2b338c-a50c-46a0-8e80-75eac228dfb8 tempest-ServerActionsTestOtherA-715488085 None] Terminate volume connection completed successfully.
Nov 07 02:34:02 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-1db5b6fc-979f-4d3b-bd56-7f27165ee087 req-ea2b338c-a50c-46a0-8e80-75eac228dfb8 tempest-ServerActionsTestOtherA-715488085 None] Deleting attachment 24772d21-fb5b-498a-b0f5-1fc0b7cfdf81. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:34:02 devstack sudo[92581]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.5b882e90-b5a3-45ff-be0f-b8eeff1883b5" returned: 0 in 0.537s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:02 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:34:02 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc44e4d3-f289-4420-bc27-8639b4cb20c5]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:02 devstack sudo[92590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a
Nov 07 02:34:02 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:03 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a" returned: 0 in 0.655s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.5b882e90-b5a3-45ff-be0f-b8eeff1883b5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:03 devstack sudo[92596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.5b882e90-b5a3-45ff-be0f-b8eeff1883b5
Nov 07 02:34:03 devstack sudo[92596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:03 devstack sudo[92596]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.5b882e90-b5a3-45ff-be0f-b8eeff1883b5" returned: 0 in 0.464s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.5b882e90-b5a3-45ff-be0f-b8eeff1883b5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:03 devstack sudo[92601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.5b882e90-b5a3-45ff-be0f-b8eeff1883b5
Nov 07 02:34:03 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:04 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a.5b882e90-b5a3-45ff-be0f-b8eeff1883b5" returned: 0 in 0.374s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-quobyte-5b882e90-b5a3-45ff-be0f-b8eeff1883b5" released by "_delete_snapshot" :: held 2.230s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-quobyte-7644bc5e-c753-424e-ae3b-f8d9ede7e51a" released by "delete_snapshot" :: held 2.270s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:04 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Created reservations ['0b75da9f-3e2b-41c9-8004-fc8c6d7fb539', 'e6dbb9b3-7a42-45cf-8006-b35c87288f2a', '0f9a0013-4c86-4e62-8a70-4c1edc612e82', '0df12f4b-2a71-46db-a4b7-eae18bd4386e'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:34:04 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Delete snapshot completed successfully.
Nov 07 02:34:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-5b882e90-b5a3-45ff-be0f-b8eeff1883b5-delete_snapshot" released by "delete_snapshot" :: held 2.562s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Snapshots deleted, issuing volume delete {{(pid=87054) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 07 02:34:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "cinder-quobyte-7644bc5e-c753-424e-ae3b-f8d9ede7e51a" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-quobyte-7644bc5e-c753-424e-ae3b-f8d9ede7e51a" acquired by "delete_volume" :: waited 0.042s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:04 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3719ef1-37fb-4e49-aee4-20bf8235290e]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:04 devstack sudo[92607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a
Nov 07 02:34:04 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:04 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a" returned: 0 in 0.495s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:05 devstack sudo[92612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a
Nov 07 02:34:05 devstack sudo[92612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:05 devstack sudo[92612]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7644bc5e-c753-424e-ae3b-f8d9ede7e51a" returned: 0 in 0.292s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-quobyte-7644bc5e-c753-424e-ae3b-f8d9ede7e51a" released by "delete_volume" :: held 0.890s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:05 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Created reservations ['4718438b-b643-43c2-88d2-f4fac434c0ec', '19ee14b1-a044-4382-99b6-d77d84f6ebd3', '79a204a7-befd-4980-98a4-f00c60ed783f', '7738712a-b77d-4ed5-af6e-684a3d560f32'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:34:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:05 devstack sudo[92616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:34:05 devstack sudo[92616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:05 devstack sudo[92616]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.300s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:05 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:34:05 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Deleted volume successfully.
Nov 07 02:34:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6b528aa0-24c3-4521-8132-35548305c5d0 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-7644bc5e-c753-424e-ae3b-f8d9ede7e51a-delete_volume" released by "delete_volume" :: held 4.170s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:06 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-48b1a845-4b58-4fda-88ed-56bb92c90f42 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "cinder-2bcd6ac3-e80f-47c5-907e-764bcda67983-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:06 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-48b1a845-4b58-4fda-88ed-56bb92c90f42 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-2bcd6ac3-e80f-47c5-907e-764bcda67983-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:06 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-48b1a845-4b58-4fda-88ed-56bb92c90f42 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "cinder-quobyte-2bcd6ac3-e80f-47c5-907e-764bcda67983" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:06 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-48b1a845-4b58-4fda-88ed-56bb92c90f42 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-quobyte-2bcd6ac3-e80f-47c5-907e-764bcda67983" acquired by "delete_volume" :: waited 0.027s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:06 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[406624db-dc04-4d6e-bd16-9910f04918f7]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-48b1a845-4b58-4fda-88ed-56bb92c90f42 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2bcd6ac3-e80f-47c5-907e-764bcda67983 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:06 devstack sudo[92619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2bcd6ac3-e80f-47c5-907e-764bcda67983
Nov 07 02:34:06 devstack sudo[92619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:06 devstack sudo[92619]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-48b1a845-4b58-4fda-88ed-56bb92c90f42 tempest-VolumesDeleteCascade-969973790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2bcd6ac3-e80f-47c5-907e-764bcda67983" returned: 0 in 0.556s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-48b1a845-4b58-4fda-88ed-56bb92c90f42 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2bcd6ac3-e80f-47c5-907e-764bcda67983 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:06 devstack sudo[92624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2bcd6ac3-e80f-47c5-907e-764bcda67983
Nov 07 02:34:06 devstack sudo[92624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:07 devstack sudo[92624]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-48b1a845-4b58-4fda-88ed-56bb92c90f42 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2bcd6ac3-e80f-47c5-907e-764bcda67983" returned: 0 in 0.255s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-48b1a845-4b58-4fda-88ed-56bb92c90f42 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-quobyte-2bcd6ac3-e80f-47c5-907e-764bcda67983" released by "delete_volume" :: held 0.865s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:07 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-48b1a845-4b58-4fda-88ed-56bb92c90f42 tempest-VolumesDeleteCascade-969973790 None] Created reservations ['5dc185f1-9e98-4709-bdf7-e221a5e8a157', '23001d6b-b9e0-457d-a99f-c539d1f76c2c', 'ee5f2127-a3c9-4ee1-b388-1c01c11ff79c', '377a76ee-b63a-4e4f-a33b-554b551d69a3'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:34:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-48b1a845-4b58-4fda-88ed-56bb92c90f42 tempest-VolumesDeleteCascade-969973790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-48b1a845-4b58-4fda-88ed-56bb92c90f42 tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:07 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-48b1a845-4b58-4fda-88ed-56bb92c90f42 tempest-VolumesDeleteCascade-969973790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:07 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-48b1a845-4b58-4fda-88ed-56bb92c90f42 tempest-VolumesDeleteCascade-969973790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-48b1a845-4b58-4fda-88ed-56bb92c90f42 tempest-VolumesDeleteCascade-969973790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-48b1a845-4b58-4fda-88ed-56bb92c90f42 tempest-VolumesDeleteCascade-969973790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:07 devstack sudo[92628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:34:07 devstack sudo[92628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:07 devstack sudo[92628]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-48b1a845-4b58-4fda-88ed-56bb92c90f42 tempest-VolumesDeleteCascade-969973790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.373s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:07 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-48b1a845-4b58-4fda-88ed-56bb92c90f42 tempest-VolumesDeleteCascade-969973790 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:34:07 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-48b1a845-4b58-4fda-88ed-56bb92c90f42 tempest-VolumesDeleteCascade-969973790 None] Deleted volume successfully.
Nov 07 02:34:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-48b1a845-4b58-4fda-88ed-56bb92c90f42 tempest-VolumesDeleteCascade-969973790 None] Lock "cinder-2bcd6ac3-e80f-47c5-907e-764bcda67983-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-1db5b6fc-979f-4d3b-bd56-7f27165ee087 req-adf3c13e-47f9-4f88-b96e-c3e4eef12352 tempest-ServerActionsTestOtherA-715488085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-1db5b6fc-979f-4d3b-bd56-7f27165ee087 req-adf3c13e-47f9-4f88-b96e-c3e4eef12352 tempest-ServerActionsTestOtherA-715488085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-1db5b6fc-979f-4d3b-bd56-7f27165ee087 req-adf3c13e-47f9-4f88-b96e-c3e4eef12352 tempest-ServerActionsTestOtherA-715488085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:10 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-1db5b6fc-979f-4d3b-bd56-7f27165ee087 req-adf3c13e-47f9-4f88-b96e-c3e4eef12352 tempest-ServerActionsTestOtherA-715488085 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c', 'name': 'volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe17bd80-be87-4425-b148-acd7c5d69285', 'enforce_multipath': True} {{(pid=87054) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:34:10 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-1db5b6fc-979f-4d3b-bd56-7f27165ee087 req-adf3c13e-47f9-4f88-b96e-c3e4eef12352 tempest-ServerActionsTestOtherA-715488085 None] attachment_update completed successfully.
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Flow 'volume_create_manager' (e570ed21-ef28-4add-bdb0-3ddd4ee9b4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb919032-d70b-45ad-9759-79851f8b13c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb919032-d70b-45ad-9759-79851f8b13c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-883545553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a4ba8d055343e5b51341f7f0291290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:13Z,use_quota=True,user_id='32367fa0b10b4e1bb645b0a0ec18799c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84361e01-9560-4924-989f-8f2785b4f2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84361e01-9560-4924-989f-8f2785b4f2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac692597-9872-45e9-aece-0a5579a61f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac692597-9872-45e9-aece-0a5579a61f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c', 'volume_name': 'volume-f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab4d059-e28b-45fd-9944-b2d30ba867bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab4d059-e28b-45fd-9944-b2d30ba867bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ef750d4-2050-4202-9cdc-6b0bc94fbbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:13 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Volume f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c', 'volume_size': 1}
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-883545553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a4ba8d055343e5b51341f7f0291290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:13Z,use_quota=True,user_id='32367fa0b10b4e1bb645b0a0ec18799c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Creating volume f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:34:13 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:13 devstack sudo[93092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c 1073741824
Nov 07 02:34:13 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:13 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c 1073741824" returned: 0 in 0.789s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:14 devstack sudo[93106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c
Nov 07 02:34:14 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:14 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c" returned: 0 in 0.484s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:34:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ef750d4-2050-4202-9cdc-6b0bc94fbbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa82382-5a00-4b15-8b0a-3ae7c7e4a516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:14 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Volume volume-f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c (f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c): created successfully
Nov 07 02:34:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa82382-5a00-4b15-8b0a-3ae7c7e4a516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Flow 'volume_create_manager' (e570ed21-ef28-4add-bdb0-3ddd4ee9b4cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:14 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-e009dca7-a9b7-4fe0-9967-435f5799a136 tempest-VolumesMetadataTest-1417262589 None] Created volume successfully.
Nov 07 02:34:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-69c35ba0-e99a-4e00-a90d-d3fd1343ac57 tempest-VolumesMetadataTest-1417262589 None] Acquiring lock "cinder-f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-69c35ba0-e99a-4e00-a90d-d3fd1343ac57 tempest-VolumesMetadataTest-1417262589 None] Lock "cinder-f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-69c35ba0-e99a-4e00-a90d-d3fd1343ac57 tempest-VolumesMetadataTest-1417262589 None] Acquiring lock "cinder-quobyte-f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-69c35ba0-e99a-4e00-a90d-d3fd1343ac57 tempest-VolumesMetadataTest-1417262589 None] Lock "cinder-quobyte-f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c" acquired by "delete_volume" :: waited 0.041s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:16 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca115b1-2602-47ae-a7a3-bbdcfd01162c]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-69c35ba0-e99a-4e00-a90d-d3fd1343ac57 tempest-VolumesMetadataTest-1417262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:17 devstack sudo[93111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c
Nov 07 02:34:17 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:17 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-69c35ba0-e99a-4e00-a90d-d3fd1343ac57 tempest-VolumesMetadataTest-1417262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c" returned: 0 in 0.752s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-69c35ba0-e99a-4e00-a90d-d3fd1343ac57 tempest-VolumesMetadataTest-1417262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:17 devstack sudo[93117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c
Nov 07 02:34:17 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:18 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-69c35ba0-e99a-4e00-a90d-d3fd1343ac57 tempest-VolumesMetadataTest-1417262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c" returned: 0 in 0.765s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-69c35ba0-e99a-4e00-a90d-d3fd1343ac57 tempest-VolumesMetadataTest-1417262589 None] Lock "cinder-quobyte-f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c" released by "delete_volume" :: held 1.590s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:18 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-69c35ba0-e99a-4e00-a90d-d3fd1343ac57 tempest-VolumesMetadataTest-1417262589 None] Created reservations ['30ccd4f6-c377-4100-8e93-8fec1223cfe6', 'a2f1cd64-e349-4f6d-b6d7-c1d63cd0acd5', 'a61a5d6a-8b6d-4576-8baf-185aba141a2b', 'b0e4299e-cc50-4986-85bf-253f1c757837'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:34:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-69c35ba0-e99a-4e00-a90d-d3fd1343ac57 tempest-VolumesMetadataTest-1417262589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-69c35ba0-e99a-4e00-a90d-d3fd1343ac57 tempest-VolumesMetadataTest-1417262589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:18 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-69c35ba0-e99a-4e00-a90d-d3fd1343ac57 tempest-VolumesMetadataTest-1417262589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:18 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-69c35ba0-e99a-4e00-a90d-d3fd1343ac57 tempest-VolumesMetadataTest-1417262589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-69c35ba0-e99a-4e00-a90d-d3fd1343ac57 tempest-VolumesMetadataTest-1417262589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-69c35ba0-e99a-4e00-a90d-d3fd1343ac57 tempest-VolumesMetadataTest-1417262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:19 devstack sudo[93124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:34:19 devstack sudo[93124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:19 devstack sudo[93124]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-69c35ba0-e99a-4e00-a90d-d3fd1343ac57 tempest-VolumesMetadataTest-1417262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.837s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:19 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-69c35ba0-e99a-4e00-a90d-d3fd1343ac57 tempest-VolumesMetadataTest-1417262589 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:34:19 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-69c35ba0-e99a-4e00-a90d-d3fd1343ac57 tempest-VolumesMetadataTest-1417262589 None] Deleted volume successfully.
Nov 07 02:34:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-69c35ba0-e99a-4e00-a90d-d3fd1343ac57 tempest-VolumesMetadataTest-1417262589 None] Lock "cinder-f4c1d1af-fbf7-41a2-a4c2-2b0a909e156c-delete_volume" released by "delete_volume" :: held 3.049s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:28 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=34,cinder:INSERT=12,cinder:UPDATE=34,cinder:DELETE=3 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:34:29 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:UPDATE=39,cinder:SELECT=29,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:34:30 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:34:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Flow 'volume_create_manager' (2d9e40c0-af67-4580-adb4-b6144446371e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4f92ae-5ed6-460b-81bc-c83c1006a5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4f92ae-5ed6-460b-81bc-c83c1006a5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1219585028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1a4867849e74bdd96f96b85509e49d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:31Z,use_quota=True,user_id='f0e585dd3ceb423696ac2a7c203d2a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ffac8d-c042-45ae-b386-b97e30c7cf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ffac8d-c042-45ae-b386-b97e30c7cf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854c70c5-8473-43db-9981-26502aa04258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854c70c5-8473-43db-9981-26502aa04258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f', 'volume_name': 'volume-9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ef25c5-6bb3-404d-bc86-837e2b4d2481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ef25c5-6bb3-404d-bc86-837e2b4d2481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b23400-8ff4-46f0-9f82-8d204a128cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:30 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Volume 9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f', 'volume_size': 1}
Nov 07 02:34:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1219585028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1a4867849e74bdd96f96b85509e49d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:31Z,use_quota=True,user_id='f0e585dd3ceb423696ac2a7c203d2a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:34:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Creating volume 9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:34:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:34:30 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:34:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:31 devstack sudo[93245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f 1073741824
Nov 07 02:34:31 devstack sudo[93245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:31 devstack sudo[93245]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f 1073741824" returned: 0 in 0.882s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:31 devstack sudo[93276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f
Nov 07 02:34:31 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:32 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f" returned: 0 in 0.310s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:32 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:34:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b23400-8ff4-46f0-9f82-8d204a128cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af899d17-3b2d-42a3-845a-740536edc217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:32 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Volume volume-9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f (9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f): created successfully
Nov 07 02:34:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af899d17-3b2d-42a3-845a-740536edc217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Flow 'volume_create_manager' (2d9e40c0-af67-4580-adb4-b6144446371e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:32 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-5c0fb380-7e15-46ba-aa0a-374005ff0374 tempest-VolumesTransfersV355Test-847356774 None] Created volume successfully.
Nov 07 02:34:34 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b5a9c77e-3249-428c-9321-a0e71f4fbcd1 tempest-VolumesTransfersV355Test-1500259068 None] Transfer volume completed successfully.
Nov 07 02:34:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b4047b00-c00f-4ab6-9fa6-e97d3c67605d tempest-VolumesTransfersV355Test-730382240 None] Acquiring lock "cinder-9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b4047b00-c00f-4ab6-9fa6-e97d3c67605d tempest-VolumesTransfersV355Test-730382240 None] Lock "cinder-9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b4047b00-c00f-4ab6-9fa6-e97d3c67605d tempest-VolumesTransfersV355Test-730382240 None] Acquiring lock "cinder-quobyte-9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b4047b00-c00f-4ab6-9fa6-e97d3c67605d tempest-VolumesTransfersV355Test-730382240 None] Lock "cinder-quobyte-9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f" acquired by "delete_volume" :: waited 0.047s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:35 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[457c1ca1-580b-4aed-bd70-51d8099de0bb]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b4047b00-c00f-4ab6-9fa6-e97d3c67605d tempest-VolumesTransfersV355Test-730382240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:35 devstack sudo[93352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f
Nov 07 02:34:35 devstack sudo[93352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:36 devstack sudo[93352]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b4047b00-c00f-4ab6-9fa6-e97d3c67605d tempest-VolumesTransfersV355Test-730382240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f" returned: 0 in 0.482s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b4047b00-c00f-4ab6-9fa6-e97d3c67605d tempest-VolumesTransfersV355Test-730382240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:36 devstack sudo[93357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f
Nov 07 02:34:36 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:36 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b4047b00-c00f-4ab6-9fa6-e97d3c67605d tempest-VolumesTransfersV355Test-730382240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f" returned: 0 in 0.391s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b4047b00-c00f-4ab6-9fa6-e97d3c67605d tempest-VolumesTransfersV355Test-730382240 None] Lock "cinder-quobyte-9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f" released by "delete_volume" :: held 0.966s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:36 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-b4047b00-c00f-4ab6-9fa6-e97d3c67605d tempest-VolumesTransfersV355Test-730382240 None] Created reservations ['f5705556-340d-4c9e-8c30-db19d339de30', '6028c0b3-b737-4fa6-9562-7f060de8e019', '59abfa85-2f5e-4143-96ac-cf1818c39221', 'cb08c06a-3e53-43f7-8ba2-1d1cb76e6ded'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:34:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b4047b00-c00f-4ab6-9fa6-e97d3c67605d tempest-VolumesTransfersV355Test-730382240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b4047b00-c00f-4ab6-9fa6-e97d3c67605d tempest-VolumesTransfersV355Test-730382240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b4047b00-c00f-4ab6-9fa6-e97d3c67605d tempest-VolumesTransfersV355Test-730382240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b4047b00-c00f-4ab6-9fa6-e97d3c67605d tempest-VolumesTransfersV355Test-730382240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b4047b00-c00f-4ab6-9fa6-e97d3c67605d tempest-VolumesTransfersV355Test-730382240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b4047b00-c00f-4ab6-9fa6-e97d3c67605d tempest-VolumesTransfersV355Test-730382240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:36 devstack sudo[93360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:34:36 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:37 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b4047b00-c00f-4ab6-9fa6-e97d3c67605d tempest-VolumesTransfersV355Test-730382240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.380s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:37 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-b4047b00-c00f-4ab6-9fa6-e97d3c67605d tempest-VolumesTransfersV355Test-730382240 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:34:37 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b4047b00-c00f-4ab6-9fa6-e97d3c67605d tempest-VolumesTransfersV355Test-730382240 None] Deleted volume successfully.
Nov 07 02:34:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b4047b00-c00f-4ab6-9fa6-e97d3c67605d tempest-VolumesTransfersV355Test-730382240 None] Lock "cinder-9f8ee3e7-af2e-4b36-9fab-5cd5aafd039f-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:39 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:34:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Flow 'volume_create_manager' (05a94240-d4c5-4109-9257-65322d6224e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7c81fe-74e1-4f54-9135-2d1b7ece8e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7c81fe-74e1-4f54-9135-2d1b7ece8e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-468966010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b1e29aa-3b6c-443e-953a-57e8768304ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1a4867849e74bdd96f96b85509e49d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:39Z,use_quota=True,user_id='f0e585dd3ceb423696ac2a7c203d2a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99472cfd-e822-4c6d-a065-5c33b919051d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99472cfd-e822-4c6d-a065-5c33b919051d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626419ac-1716-47ad-9594-dbcbc7e6294e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626419ac-1716-47ad-9594-dbcbc7e6294e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b1e29aa-3b6c-443e-953a-57e8768304ff', 'volume_name': 'volume-1b1e29aa-3b6c-443e-953a-57e8768304ff', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb960a0-f0a5-451e-94fb-a1cb28988d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb960a0-f0a5-451e-94fb-a1cb28988d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9653d17-d0b7-4d0f-9c93-8022593b8958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:39 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Volume 1b1e29aa-3b6c-443e-953a-57e8768304ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b1e29aa-3b6c-443e-953a-57e8768304ff', 'volume_size': 1}
Nov 07 02:34:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-468966010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b1e29aa-3b6c-443e-953a-57e8768304ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1a4867849e74bdd96f96b85509e49d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:39Z,use_quota=True,user_id='f0e585dd3ceb423696ac2a7c203d2a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:34:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Creating volume 1b1e29aa-3b6c-443e-953a-57e8768304ff {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:34:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:34:39 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:34:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b1e29aa-3b6c-443e-953a-57e8768304ff 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:39 devstack sudo[93382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b1e29aa-3b6c-443e-953a-57e8768304ff 1073741824
Nov 07 02:34:39 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:40 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b1e29aa-3b6c-443e-953a-57e8768304ff 1073741824" returned: 0 in 1.044s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b1e29aa-3b6c-443e-953a-57e8768304ff {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:40 devstack sudo[93395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b1e29aa-3b6c-443e-953a-57e8768304ff
Nov 07 02:34:40 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:41 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b1e29aa-3b6c-443e-953a-57e8768304ff" returned: 0 in 0.515s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:34:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:41 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9653d17-d0b7-4d0f-9c93-8022593b8958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b1e29aa-3b6c-443e-953a-57e8768304ff', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:41 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a630d9d4-de0f-4161-a293-d002fccc221d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:41 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Volume volume-1b1e29aa-3b6c-443e-953a-57e8768304ff (1b1e29aa-3b6c-443e-953a-57e8768304ff): created successfully
Nov 07 02:34:41 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a630d9d4-de0f-4161-a293-d002fccc221d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:41 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Flow 'volume_create_manager' (05a94240-d4c5-4109-9257-65322d6224e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:41 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-cc6f6d8a-0da0-41e8-979a-283a99ddd942 tempest-VolumesTransfersV355Test-847356774 None] Created volume successfully.
Nov 07 02:34:42 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d56a6f24-88be-4a16-bc11-e32460746393 tempest-VolumesTransfersV355Test-730382240 None] Acquiring lock "cinder-1b1e29aa-3b6c-443e-953a-57e8768304ff-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:42 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d56a6f24-88be-4a16-bc11-e32460746393 tempest-VolumesTransfersV355Test-730382240 None] Lock "cinder-1b1e29aa-3b6c-443e-953a-57e8768304ff-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:42 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d56a6f24-88be-4a16-bc11-e32460746393 tempest-VolumesTransfersV355Test-730382240 None] Acquiring lock "cinder-quobyte-1b1e29aa-3b6c-443e-953a-57e8768304ff" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:42 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d56a6f24-88be-4a16-bc11-e32460746393 tempest-VolumesTransfersV355Test-730382240 None] Lock "cinder-quobyte-1b1e29aa-3b6c-443e-953a-57e8768304ff" acquired by "delete_volume" :: waited 0.026s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:42 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58277db-db48-44dc-ad6a-0c8d4bec8821]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d56a6f24-88be-4a16-bc11-e32460746393 tempest-VolumesTransfersV355Test-730382240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b1e29aa-3b6c-443e-953a-57e8768304ff {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:43 devstack sudo[93428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b1e29aa-3b6c-443e-953a-57e8768304ff
Nov 07 02:34:43 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:43 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d56a6f24-88be-4a16-bc11-e32460746393 tempest-VolumesTransfersV355Test-730382240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b1e29aa-3b6c-443e-953a-57e8768304ff" returned: 0 in 0.462s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d56a6f24-88be-4a16-bc11-e32460746393 tempest-VolumesTransfersV355Test-730382240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b1e29aa-3b6c-443e-953a-57e8768304ff {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:43 devstack sudo[93439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b1e29aa-3b6c-443e-953a-57e8768304ff
Nov 07 02:34:43 devstack sudo[93439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:43 devstack sudo[93439]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d56a6f24-88be-4a16-bc11-e32460746393 tempest-VolumesTransfersV355Test-730382240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b1e29aa-3b6c-443e-953a-57e8768304ff" returned: 0 in 0.278s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:43 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d56a6f24-88be-4a16-bc11-e32460746393 tempest-VolumesTransfersV355Test-730382240 None] Lock "cinder-quobyte-1b1e29aa-3b6c-443e-953a-57e8768304ff" released by "delete_volume" :: held 0.797s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:43 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-d56a6f24-88be-4a16-bc11-e32460746393 tempest-VolumesTransfersV355Test-730382240 None] Created reservations ['ebfc7389-20e5-4826-931c-d0655464a5eb', 'd30a5449-71aa-4b97-909e-8b2a2787147c', 'd7a1bc34-eb17-4276-a5a6-cecd9808089c', '286df763-f4ca-4bc2-8835-7590e65be040'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:34:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d56a6f24-88be-4a16-bc11-e32460746393 tempest-VolumesTransfersV355Test-730382240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d56a6f24-88be-4a16-bc11-e32460746393 tempest-VolumesTransfersV355Test-730382240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d56a6f24-88be-4a16-bc11-e32460746393 tempest-VolumesTransfersV355Test-730382240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d56a6f24-88be-4a16-bc11-e32460746393 tempest-VolumesTransfersV355Test-730382240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d56a6f24-88be-4a16-bc11-e32460746393 tempest-VolumesTransfersV355Test-730382240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d56a6f24-88be-4a16-bc11-e32460746393 tempest-VolumesTransfersV355Test-730382240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:43 devstack sudo[93449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:34:43 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:44 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d56a6f24-88be-4a16-bc11-e32460746393 tempest-VolumesTransfersV355Test-730382240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.336s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:44 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-d56a6f24-88be-4a16-bc11-e32460746393 tempest-VolumesTransfersV355Test-730382240 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:34:44 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-d56a6f24-88be-4a16-bc11-e32460746393 tempest-VolumesTransfersV355Test-730382240 None] Deleted volume successfully.
Nov 07 02:34:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d56a6f24-88be-4a16-bc11-e32460746393 tempest-VolumesTransfersV355Test-730382240 None] Lock "cinder-1b1e29aa-3b6c-443e-953a-57e8768304ff-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:47 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-209b38c7-5045-42d4-b93a-19b867953cbc req-16feb556-93c8-424e-a969-30927f18f0f6 tempest-ServerActionsTestOtherA-715488085 None] Terminate volume connection completed successfully.
Nov 07 02:34:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-209b38c7-5045-42d4-b93a-19b867953cbc req-16feb556-93c8-424e-a969-30927f18f0f6 tempest-ServerActionsTestOtherA-715488085 None] Deleting attachment fe17bd80-be87-4425-b148-acd7c5d69285. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:34:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-209b38c7-5045-42d4-b93a-19b867953cbc req-9fc45aea-80ea-40f5-9a6b-6f343d5f3eb5 tempest-ServerActionsTestOtherA-715488085 None] Acquiring lock "cinder-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-209b38c7-5045-42d4-b93a-19b867953cbc req-9fc45aea-80ea-40f5-9a6b-6f343d5f3eb5 tempest-ServerActionsTestOtherA-715488085 None] Lock "cinder-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-209b38c7-5045-42d4-b93a-19b867953cbc req-9fc45aea-80ea-40f5-9a6b-6f343d5f3eb5 tempest-ServerActionsTestOtherA-715488085 None] Acquiring lock "cinder-quobyte-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-209b38c7-5045-42d4-b93a-19b867953cbc req-9fc45aea-80ea-40f5-9a6b-6f343d5f3eb5 tempest-ServerActionsTestOtherA-715488085 None] Lock "cinder-quobyte-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb" acquired by "delete_volume" :: waited 0.030s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:47 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d2cd91-e463-48f6-9d6e-b6bdb9b5d157]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-209b38c7-5045-42d4-b93a-19b867953cbc req-9fc45aea-80ea-40f5-9a6b-6f343d5f3eb5 tempest-ServerActionsTestOtherA-715488085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:47 devstack sudo[93483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb
Nov 07 02:34:47 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:48 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-209b38c7-5045-42d4-b93a-19b867953cbc req-9fc45aea-80ea-40f5-9a6b-6f343d5f3eb5 tempest-ServerActionsTestOtherA-715488085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb" returned: 0 in 0.560s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-209b38c7-5045-42d4-b93a-19b867953cbc req-9fc45aea-80ea-40f5-9a6b-6f343d5f3eb5 tempest-ServerActionsTestOtherA-715488085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:48 devstack sudo[93488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb
Nov 07 02:34:48 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:48 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-209b38c7-5045-42d4-b93a-19b867953cbc req-9fc45aea-80ea-40f5-9a6b-6f343d5f3eb5 tempest-ServerActionsTestOtherA-715488085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb" returned: 0 in 0.455s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-209b38c7-5045-42d4-b93a-19b867953cbc req-9fc45aea-80ea-40f5-9a6b-6f343d5f3eb5 tempest-ServerActionsTestOtherA-715488085 None] Lock "cinder-quobyte-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb" released by "delete_volume" :: held 1.078s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:48 devstack cinder-volume[87054]: DEBUG cinder.quota [req-209b38c7-5045-42d4-b93a-19b867953cbc req-9fc45aea-80ea-40f5-9a6b-6f343d5f3eb5 tempest-ServerActionsTestOtherA-715488085 None] Created reservations ['da81a1fb-7770-4bb0-84a9-f4abe7d683c2', '11840d93-6bd4-4d2e-8713-4b29c652455d', '9005e310-eb1c-4954-bd2a-9b5f7fa2f670', '3e7ffd91-3836-40a2-b381-090e6c7b9502'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:34:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-209b38c7-5045-42d4-b93a-19b867953cbc req-9fc45aea-80ea-40f5-9a6b-6f343d5f3eb5 tempest-ServerActionsTestOtherA-715488085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-209b38c7-5045-42d4-b93a-19b867953cbc req-9fc45aea-80ea-40f5-9a6b-6f343d5f3eb5 tempest-ServerActionsTestOtherA-715488085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [req-209b38c7-5045-42d4-b93a-19b867953cbc req-9fc45aea-80ea-40f5-9a6b-6f343d5f3eb5 tempest-ServerActionsTestOtherA-715488085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [req-209b38c7-5045-42d4-b93a-19b867953cbc req-9fc45aea-80ea-40f5-9a6b-6f343d5f3eb5 tempest-ServerActionsTestOtherA-715488085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-209b38c7-5045-42d4-b93a-19b867953cbc req-9fc45aea-80ea-40f5-9a6b-6f343d5f3eb5 tempest-ServerActionsTestOtherA-715488085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-209b38c7-5045-42d4-b93a-19b867953cbc req-9fc45aea-80ea-40f5-9a6b-6f343d5f3eb5 tempest-ServerActionsTestOtherA-715488085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:48 devstack sudo[93491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:34:48 devstack sudo[93491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:49 devstack sudo[93491]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-209b38c7-5045-42d4-b93a-19b867953cbc req-9fc45aea-80ea-40f5-9a6b-6f343d5f3eb5 tempest-ServerActionsTestOtherA-715488085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.305s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:49 devstack cinder-volume[87054]: DEBUG cinder.manager [req-209b38c7-5045-42d4-b93a-19b867953cbc req-9fc45aea-80ea-40f5-9a6b-6f343d5f3eb5 tempest-ServerActionsTestOtherA-715488085 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:34:49 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-209b38c7-5045-42d4-b93a-19b867953cbc req-9fc45aea-80ea-40f5-9a6b-6f343d5f3eb5 tempest-ServerActionsTestOtherA-715488085 None] Deleted volume successfully.
Nov 07 02:34:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-209b38c7-5045-42d4-b93a-19b867953cbc req-9fc45aea-80ea-40f5-9a6b-6f343d5f3eb5 tempest-ServerActionsTestOtherA-715488085 None] Lock "cinder-b136e5e6-ad46-4e62-8ae2-c6f27efcbaeb-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-769e48b0-21d7-4168-9528-7bc8cb08bfef tempest-ServerActionsTestOtherA-715488085 None] Acquiring lock "cinder-6ee79c99-ae8a-4f68-9c30-057b1e43765b-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-769e48b0-21d7-4168-9528-7bc8cb08bfef tempest-ServerActionsTestOtherA-715488085 None] Lock "cinder-6ee79c99-ae8a-4f68-9c30-057b1e43765b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-769e48b0-21d7-4168-9528-7bc8cb08bfef tempest-ServerActionsTestOtherA-715488085 None] Acquiring lock "cinder-quobyte-6ee79c99-ae8a-4f68-9c30-057b1e43765b" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:34:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-769e48b0-21d7-4168-9528-7bc8cb08bfef tempest-ServerActionsTestOtherA-715488085 None] Lock "cinder-quobyte-6ee79c99-ae8a-4f68-9c30-057b1e43765b" acquired by "delete_volume" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:34:49 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[2795fc01-6aef-4fbf-b425-1a3e2b1fbc03]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:34:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-769e48b0-21d7-4168-9528-7bc8cb08bfef tempest-ServerActionsTestOtherA-715488085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6ee79c99-ae8a-4f68-9c30-057b1e43765b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:49 devstack sudo[93511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6ee79c99-ae8a-4f68-9c30-057b1e43765b
Nov 07 02:34:49 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:50 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-769e48b0-21d7-4168-9528-7bc8cb08bfef tempest-ServerActionsTestOtherA-715488085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6ee79c99-ae8a-4f68-9c30-057b1e43765b" returned: 0 in 0.388s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-769e48b0-21d7-4168-9528-7bc8cb08bfef tempest-ServerActionsTestOtherA-715488085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6ee79c99-ae8a-4f68-9c30-057b1e43765b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:50 devstack sudo[93516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6ee79c99-ae8a-4f68-9c30-057b1e43765b
Nov 07 02:34:50 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:50 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-769e48b0-21d7-4168-9528-7bc8cb08bfef tempest-ServerActionsTestOtherA-715488085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6ee79c99-ae8a-4f68-9c30-057b1e43765b" returned: 0 in 0.287s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-769e48b0-21d7-4168-9528-7bc8cb08bfef tempest-ServerActionsTestOtherA-715488085 None] Lock "cinder-quobyte-6ee79c99-ae8a-4f68-9c30-057b1e43765b" released by "delete_volume" :: held 0.730s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:50 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-769e48b0-21d7-4168-9528-7bc8cb08bfef tempest-ServerActionsTestOtherA-715488085 None] Created reservations ['0717fe22-baef-4cfb-a5bb-d0cb7ca3366d', 'd103473a-7ed0-4ca8-8a23-a4f67720063a', '2c933318-8909-438e-b607-9d8f60cb9a8f', '963007bf-cdfb-4a57-b4d5-bdb427287400'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:34:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-769e48b0-21d7-4168-9528-7bc8cb08bfef tempest-ServerActionsTestOtherA-715488085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-769e48b0-21d7-4168-9528-7bc8cb08bfef tempest-ServerActionsTestOtherA-715488085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:50 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-769e48b0-21d7-4168-9528-7bc8cb08bfef tempest-ServerActionsTestOtherA-715488085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:50 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-769e48b0-21d7-4168-9528-7bc8cb08bfef tempest-ServerActionsTestOtherA-715488085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-769e48b0-21d7-4168-9528-7bc8cb08bfef tempest-ServerActionsTestOtherA-715488085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-769e48b0-21d7-4168-9528-7bc8cb08bfef tempest-ServerActionsTestOtherA-715488085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:50 devstack sudo[93519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:34:50 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:50 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-769e48b0-21d7-4168-9528-7bc8cb08bfef tempest-ServerActionsTestOtherA-715488085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.286s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:50 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-769e48b0-21d7-4168-9528-7bc8cb08bfef tempest-ServerActionsTestOtherA-715488085 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:34:50 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-769e48b0-21d7-4168-9528-7bc8cb08bfef tempest-ServerActionsTestOtherA-715488085 None] Deleted volume successfully.
Nov 07 02:34:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-769e48b0-21d7-4168-9528-7bc8cb08bfef tempest-ServerActionsTestOtherA-715488085 None] Lock "cinder-6ee79c99-ae8a-4f68-9c30-057b1e43765b-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Flow 'volume_create_manager' (dbaf457f-7b58-4e8a-90ba-d587d40cfc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4836887-30fa-4dbe-b04c-c6da81a1d9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4836887-30fa-4dbe-b04c-c6da81a1d9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-364121741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5522e9f8-b14b-4259-bd81-e191b73e3216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f629c9d39f154a99acbd898dfc32fb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:53Z,use_quota=True,user_id='bd8abfaba1594dacb3320500df5a6dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1d9061-c9d6-4f84-9359-e6bde48a33d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1d9061-c9d6-4f84-9359-e6bde48a33d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc5da6bd-16dd-455a-9323-670aba3d63d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc5da6bd-16dd-455a-9323-670aba3d63d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5522e9f8-b14b-4259-bd81-e191b73e3216', 'volume_name': 'volume-5522e9f8-b14b-4259-bd81-e191b73e3216', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fee0fb-465b-42b3-97b8-9219eb5507c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fee0fb-465b-42b3-97b8-9219eb5507c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914bb54c-9059-4cf7-a6f2-0d423046e2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:53 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Volume 5522e9f8-b14b-4259-bd81-e191b73e3216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5522e9f8-b14b-4259-bd81-e191b73e3216', 'volume_size': 1}
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-364121741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5522e9f8-b14b-4259-bd81-e191b73e3216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f629c9d39f154a99acbd898dfc32fb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:34:53Z,use_quota=True,user_id='bd8abfaba1594dacb3320500df5a6dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Creating volume 5522e9f8-b14b-4259-bd81-e191b73e3216 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:34:53 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5522e9f8-b14b-4259-bd81-e191b73e3216 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:53 devstack sudo[93584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5522e9f8-b14b-4259-bd81-e191b73e3216 1073741824
Nov 07 02:34:53 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:53 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5522e9f8-b14b-4259-bd81-e191b73e3216 1073741824" returned: 0 in 0.552s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5522e9f8-b14b-4259-bd81-e191b73e3216 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:54 devstack sudo[93592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5522e9f8-b14b-4259-bd81-e191b73e3216
Nov 07 02:34:54 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:54 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5522e9f8-b14b-4259-bd81-e191b73e3216" returned: 0 in 0.316s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:34:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914bb54c-9059-4cf7-a6f2-0d423046e2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5522e9f8-b14b-4259-bd81-e191b73e3216', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d07cf33a-f35e-4992-adde-5bf6dca9586d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:34:54 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Volume volume-5522e9f8-b14b-4259-bd81-e191b73e3216 (5522e9f8-b14b-4259-bd81-e191b73e3216): created successfully
Nov 07 02:34:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d07cf33a-f35e-4992-adde-5bf6dca9586d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:34:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Flow 'volume_create_manager' (dbaf457f-7b58-4e8a-90ba-d587d40cfc19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:34:54 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-2302f1e5-a253-436d-8811-3aebf514f9e3 tempest-AttachVolumeShelveTestJSON-365168603 None] Created volume successfully.
Nov 07 02:34:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:34:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:34:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:34:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:34:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:34:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:34:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:34:59 devstack sudo[93617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:34:59 devstack sudo[93617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:34:59 devstack sudo[93617]: pam_unix(sudo:session): session closed for user root
Nov 07 02:34:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.435s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:34:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:34:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:34:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 28 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:34:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>, <Thread(fd_logger, started daemon 125443282798592)>, <Thread(privsep_reader, started daemon 125443284556288)>, <Thread(tpool_thread_0, started daemon 125443276445376)>, <Thread(tpool_thread_1, started daemon 125443268036288)>, <Thread(tpool_thread_2, started daemon 125443259627200)>, <Thread(tpool_thread_3, started daemon 125443251218112)>, <Thread(tpool_thread_4, started daemon 125443242809024)>, <Thread(tpool_thread_5, started daemon 125443234399936)>, <Thread(tpool_thread_6, started daemon 125443225990848)>, <Thread(tpool_thread_7, started daemon 125443217581760)>, <Thread(tpool_thread_8, started daemon 125443209172672)>, <Thread(tpool_thread_9, started daemon 125443200763584)>, <Thread(tpool_thread_10, started daemon 125443192354496)>, <Thread(tpool_thread_11, started daemon 125443183945408)>, <Thread(tpool_thread_12, started daemon 125443175536320)>, <Thread(tpool_thread_13, started daemon 125443167127232)>, <Thread(tpool_thread_14, started daemon 125443158718144)>, <Thread(tpool_thread_15, started daemon 125443150309056)>, <Thread(tpool_thread_16, started daemon 125443141899968)>, <Thread(tpool_thread_17, started daemon 125443133490880)>, <Thread(tpool_thread_18, started daemon 125443125081792)>, <Thread(tpool_thread_19, started daemon 125443116672704)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:35:00 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:35:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Flow 'volume_create_manager' (7cb6b3fa-cf74-4bd7-a93d-e036a3e17439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:35:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb34705-86d8-4589-bd2b-af10c443f237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb34705-86d8-4589-bd2b-af10c443f237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-756785231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a2b6bf-553d-424b-aa0f-3247e607b7ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30ae1aab583410aa3de4619434d50bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:35:01Z,use_quota=True,user_id='5eaa9870c80548608ef49030140e600d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27140622-e634-4b53-8893-c7bbc1f4ff4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27140622-e634-4b53-8893-c7bbc1f4ff4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae306134-2ff5-4518-8d3a-44504fde03d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae306134-2ff5-4518-8d3a-44504fde03d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94a2b6bf-553d-424b-aa0f-3247e607b7ab', 'volume_name': 'volume-94a2b6bf-553d-424b-aa0f-3247e607b7ab', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d375c92-632b-483c-a385-99d6e1155eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d375c92-632b-483c-a385-99d6e1155eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc4df72-1c43-48f1-a6a7-d761644fa87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:00 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Volume 94a2b6bf-553d-424b-aa0f-3247e607b7ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94a2b6bf-553d-424b-aa0f-3247e607b7ab', 'volume_size': 1}
Nov 07 02:35:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:00 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-756785231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a2b6bf-553d-424b-aa0f-3247e607b7ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30ae1aab583410aa3de4619434d50bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:35:01Z,use_quota=True,user_id='5eaa9870c80548608ef49030140e600d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:35:00 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Creating volume 94a2b6bf-553d-424b-aa0f-3247e607b7ab {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:35:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:00 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:35:00 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:35:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:00 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:35:00 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:35:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-94a2b6bf-553d-424b-aa0f-3247e607b7ab 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:00 devstack sudo[93623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-94a2b6bf-553d-424b-aa0f-3247e607b7ab 1073741824
Nov 07 02:35:00 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:01 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-94a2b6bf-553d-424b-aa0f-3247e607b7ab 1073741824" returned: 0 in 0.754s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-94a2b6bf-553d-424b-aa0f-3247e607b7ab {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:01 devstack sudo[93631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-94a2b6bf-553d-424b-aa0f-3247e607b7ab
Nov 07 02:35:01 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:01 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-94a2b6bf-553d-424b-aa0f-3247e607b7ab" returned: 0 in 0.408s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:01 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:35:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:02 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc4df72-1c43-48f1-a6a7-d761644fa87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94a2b6bf-553d-424b-aa0f-3247e607b7ab', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:02 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309a10db-31fa-4621-b1df-0add641e648a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:02 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Volume volume-94a2b6bf-553d-424b-aa0f-3247e607b7ab (94a2b6bf-553d-424b-aa0f-3247e607b7ab): created successfully
Nov 07 02:35:02 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309a10db-31fa-4621-b1df-0add641e648a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:02 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Flow 'volume_create_manager' (7cb6b3fa-cf74-4bd7-a93d-e036a3e17439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:35:02 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f414ebdc-17fd-454a-a44b-dcc2960a2e41 tempest-AttachVolumeNegativeTest-1758341388 None] Created volume successfully.
Nov 07 02:35:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-235ad755-c705-4144-ba20-36ac64105afd req-b84120c5-9d4b-4839-957b-9ce1309ebfa6 tempest-AttachVolumeNegativeTest-1758341388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-235ad755-c705-4144-ba20-36ac64105afd req-b84120c5-9d4b-4839-957b-9ce1309ebfa6 tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-235ad755-c705-4144-ba20-36ac64105afd req-b84120c5-9d4b-4839-957b-9ce1309ebfa6 tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-235ad755-c705-4144-ba20-36ac64105afd req-b84120c5-9d4b-4839-957b-9ce1309ebfa6 tempest-AttachVolumeNegativeTest-1758341388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c', 'name': 'volume-94a2b6bf-553d-424b-aa0f-3247e607b7ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2867e01b-06b4-49d9-aa3e-8026ad17f470', 'enforce_multipath': True} {{(pid=87054) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:35:04 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-235ad755-c705-4144-ba20-36ac64105afd req-b84120c5-9d4b-4839-957b-9ce1309ebfa6 tempest-AttachVolumeNegativeTest-1758341388 None] attachment_update completed successfully.
Nov 07 02:35:04 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:35:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Flow 'volume_create_manager' (1ce63976-1cd0-46aa-904d-44db0d7e6d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:35:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f053a7-0c8d-42f8-9be5-80ad524de4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f053a7-0c8d-42f8-9be5-80ad524de4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-109169407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16490fb7-a32e-40df-a0bf-a490ff837e5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fedb864911c4f2daca4e4d5a1290074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:35:05Z,use_quota=True,user_id='3afb5cdbea104059a07795ae2401e03c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0aad699-433d-4160-a20d-b8a39302ee26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0aad699-433d-4160-a20d-b8a39302ee26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0749ce00-63a0-4108-a8bd-20fdc728854e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0749ce00-63a0-4108-a8bd-20fdc728854e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16490fb7-a32e-40df-a0bf-a490ff837e5e', 'volume_name': 'volume-16490fb7-a32e-40df-a0bf-a490ff837e5e', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6201cd52-3f0a-4d52-bf14-8622c7c68677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6201cd52-3f0a-4d52-bf14-8622c7c68677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e13234-2fae-43fb-947b-9974a45495cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:05 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Volume 16490fb7-a32e-40df-a0bf-a490ff837e5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16490fb7-a32e-40df-a0bf-a490ff837e5e', 'volume_size': 1}
Nov 07 02:35:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-109169407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16490fb7-a32e-40df-a0bf-a490ff837e5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fedb864911c4f2daca4e4d5a1290074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:35:05Z,use_quota=True,user_id='3afb5cdbea104059a07795ae2401e03c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:35:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Creating volume 16490fb7-a32e-40df-a0bf-a490ff837e5e {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:35:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:35:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:35:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:35:05 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:35:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:05 devstack sudo[93860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e 1073741824
Nov 07 02:35:05 devstack sudo[93860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:05 devstack sudo[93860]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e 1073741824" returned: 0 in 0.767s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:05 devstack sudo[94089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e
Nov 07 02:35:05 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:06 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e" returned: 0 in 0.258s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:35:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e13234-2fae-43fb-947b-9974a45495cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16490fb7-a32e-40df-a0bf-a490ff837e5e', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b896b7a5-bb44-40a3-9691-e669a81d18cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:06 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Volume volume-16490fb7-a32e-40df-a0bf-a490ff837e5e (16490fb7-a32e-40df-a0bf-a490ff837e5e): created successfully
Nov 07 02:35:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b896b7a5-bb44-40a3-9691-e669a81d18cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Flow 'volume_create_manager' (1ce63976-1cd0-46aa-904d-44db0d7e6d26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:35:06 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-8d91a153-29bb-440b-a88c-14a5c144bfd3 tempest-VolumesActionsTest-262701735 None] Created volume successfully.
Nov 07 02:35:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-84593116-42d8-4ee0-adfc-cb0b5f623851 req-9a3ad40e-8c4c-408d-8858-7debeb7204d6 tempest-AttachVolumeShelveTestJSON-365168603 None] No connector for attachment 0d48a380-0f12-460a-bf7d-470304930b3b; skipping storage backend terminate_connection call. {{(pid=87054) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Nov 07 02:35:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-84593116-42d8-4ee0-adfc-cb0b5f623851 req-9a3ad40e-8c4c-408d-8858-7debeb7204d6 tempest-AttachVolumeShelveTestJSON-365168603 None] Deleting attachment 0d48a380-0f12-460a-bf7d-470304930b3b. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:35:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-48fdc123-6a4e-4450-8664-19904d0c8b9d tempest-BackendsCapabilitiesAdminTestsJSON-981209615 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7832832336426, 'free_capacity_gb': 1773.7832832336426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87054) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 07 02:35:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b869d515-5326-40ed-96e2-c8cead68bc21 tempest-BackendsCapabilitiesAdminTestsJSON-981209615 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7832832336426, 'free_capacity_gb': 1773.7832832336426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87054) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 07 02:35:16 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=34,cinder:INSERT=11,cinder:UPDATE=53,cinder:DELETE=3 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:35:17 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:UPDATE=44,cinder:SELECT=44,cinder:INSERT=10,cinder:DELETE=6 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:35:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-51419dc2-becf-44a4-a6ad-c6d9cf0d71cd tempest-VolumesActionsTest-262701735 None] Acquiring lock "cinder-16490fb7-a32e-40df-a0bf-a490ff837e5e" by "attach_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-51419dc2-becf-44a4-a6ad-c6d9cf0d71cd tempest-VolumesActionsTest-262701735 None] Lock "cinder-16490fb7-a32e-40df-a0bf-a490ff837e5e" acquired by "attach_volume" :: waited 0.060s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:24 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-51419dc2-becf-44a4-a6ad-c6d9cf0d71cd tempest-VolumesActionsTest-262701735 None] Attaching volume 16490fb7-a32e-40df-a0bf-a490ff837e5e to instance 7f3a0ca0-371c-4a48-8466-3e1ec621da49 at mountpoint /dev/vdb on host None.
Nov 07 02:35:24 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-51419dc2-becf-44a4-a6ad-c6d9cf0d71cd tempest-VolumesActionsTest-262701735 None] Attach volume completed successfully.
Nov 07 02:35:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-51419dc2-becf-44a4-a6ad-c6d9cf0d71cd tempest-VolumesActionsTest-262701735 None] Lock "cinder-16490fb7-a32e-40df-a0bf-a490ff837e5e" released by "attach_volume" :: held 0.220s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-965a9751-31f6-48ea-be71-1bf6ef987086 tempest-VolumesActionsTest-262701735 None] Acquiring lock "cinder-16490fb7-a32e-40df-a0bf-a490ff837e5e-detach_volume" by "detach_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-965a9751-31f6-48ea-be71-1bf6ef987086 tempest-VolumesActionsTest-262701735 None] Lock "cinder-16490fb7-a32e-40df-a0bf-a490ff837e5e-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:24 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-965a9751-31f6-48ea-be71-1bf6ef987086 tempest-VolumesActionsTest-262701735 None] Detaching volume 16490fb7-a32e-40df-a0bf-a490ff837e5e from instance 7f3a0ca0-371c-4a48-8466-3e1ec621da49.
Nov 07 02:35:24 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-965a9751-31f6-48ea-be71-1bf6ef987086 tempest-VolumesActionsTest-262701735 None] Detach volume completed successfully.
Nov 07 02:35:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-965a9751-31f6-48ea-be71-1bf6ef987086 tempest-VolumesActionsTest-262701735 None] Lock "cinder-16490fb7-a32e-40df-a0bf-a490ff837e5e-detach_volume" released by "detach_volume" :: held 0.118s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:25 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c9485349-18ca-4500-b9b9-72823b8dbda6 tempest-GroupsV314Test-1830441425 None] Group tempest-GroupsV314Test-Group-2009024725: creating
Nov 07 02:35:25 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c9485349-18ca-4500-b9b9-72823b8dbda6 tempest-GroupsV314Test-1830441425 None] Group tempest-GroupsV314Test-Group-2009024725: created successfully
Nov 07 02:35:25 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c9485349-18ca-4500-b9b9-72823b8dbda6 tempest-GroupsV314Test-1830441425 None] Create group completed successfully.
Nov 07 02:35:27 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:35:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Flow 'volume_create_manager' (66077514-a287-4266-90bd-6b3a5af8f27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:35:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75356c83-513a-414d-ad5a-7d6a24201256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75356c83-513a-414d-ad5a-7d6a24201256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-358345328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=939a157c-c36f-4c6d-bdc4-aa96790c0720,host='devstack@QuobyteHD#QuobyteHD',id=3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='935390d989d044c2a3ff09f9796ef32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:35:27Z,use_quota=True,user_id='bf03524c0d4b416e816b302b3ae52792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e055dbea-a44d-452a-848e-39146bc5630e),volume_type_id=e055dbea-a44d-452a-848e-39146bc5630e)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a3458c-e784-45f9-b113-7c239e5d3d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a3458c-e784-45f9-b113-7c239e5d3d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f0d3d0-876b-4a33-9908-b670b2f99139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f0d3d0-876b-4a33-9908-b670b2f99139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb', 'volume_name': 'volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4641d225-7b8f-4808-8de5-a443ab082d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4641d225-7b8f-4808-8de5-a443ab082d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b888e7-344a-4120-b5af-155b4e106d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:27 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Volume 3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb', 'volume_size': 1}
Nov 07 02:35:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=939a157c-c36f-4c6d-bdc4-aa96790c0720,created_at=2026-11-07T01:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-358345328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=939a157c-c36f-4c6d-bdc4-aa96790c0720,host='devstack@QuobyteHD#QuobyteHD',id=3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='935390d989d044c2a3ff09f9796ef32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:35:27Z,use_quota=True,user_id='bf03524c0d4b416e816b302b3ae52792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e055dbea-a44d-452a-848e-39146bc5630e),volume_type_id=e055dbea-a44d-452a-848e-39146bc5630e)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:35:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Creating volume 3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:35:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:35:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:35:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:35:27 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:35:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:28 devstack sudo[94404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb 1073741824
Nov 07 02:35:28 devstack sudo[94404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:29 devstack sudo[94404]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb 1073741824" returned: 0 in 1.505s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:29 devstack sudo[94417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb
Nov 07 02:35:29 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:30 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb" returned: 0 in 0.519s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] <== create_volume: return (2172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:35:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.200s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b888e7-344a-4120-b5af-155b4e106d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d70f51-f539-4f9b-ad83-ac4832e3f86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:35:30 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Volume volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb (3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb): created successfully
Nov 07 02:35:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d70f51-f539-4f9b-ad83-ac4832e3f86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:35:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Flow 'volume_create_manager' (66077514-a287-4266-90bd-6b3a5af8f27b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:35:30 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ae734626-6b14-475d-b261-2b965a45eedd tempest-GroupsV314Test-1830441425 None] Created volume successfully.
Nov 07 02:35:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:31 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Cloning volume 3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb to volume df13273c-9a35-49b1-bea1-72880f821c1c
Nov 07 02:35:31 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Creating offline snapshot b854b37c-d008-49ca-804e-62083458c79d of volume 3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:35:31 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[17691382-b292-4cbb-889b-5e71677aaabe]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:31 devstack sudo[94422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb
Nov 07 02:35:31 devstack sudo[94422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:32 devstack sudo[94422]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb" returned: 0 in 0.707s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.b854b37c-d008-49ca-804e-62083458c79d 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:32 devstack sudo[94430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.b854b37c-d008-49ca-804e-62083458c79d 1G
Nov 07 02:35:32 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:33 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.b854b37c-d008-49ca-804e-62083458c79d 1G" returned: 0 in 0.828s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.b854b37c-d008-49ca-804e-62083458c79d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:33 devstack sudo[94436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.b854b37c-d008-49ca-804e-62083458c79d
Nov 07 02:35:33 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:33 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.b854b37c-d008-49ca-804e-62083458c79d" returned: 0 in 0.412s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:33 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.b854b37c-d008-49ca-804e-62083458c79d is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:35:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.b854b37c-d008-49ca-804e-62083458c79d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:33 devstack sudo[94442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.b854b37c-d008-49ca-804e-62083458c79d
Nov 07 02:35:33 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:33 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.b854b37c-d008-49ca-804e-62083458c79d" returned: 0 in 0.315s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:34 devstack sudo[94445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.info
Nov 07 02:35:34 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:34 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.info" returned: 0 in 0.354s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:34 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:35:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:34 devstack sudo[94448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.info
Nov 07 02:35:34 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:34 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.info" returned: 0 in 0.460s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Acquiring lock "cinder-quobyte-df13273c-9a35-49b1-bea1-72880f821c1c" by "_copy_volume_from_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Lock "cinder-quobyte-df13273c-9a35-49b1-bea1-72880f821c1c" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] snapshot: b854b37c-d008-49ca-804e-62083458c79d, volume: df13273c-9a35-49b1-bea1-72880f821c1c,  {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:35:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:35:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:35:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:35 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c134c1-6b70-4460-8895-fb056efaf95b]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.b854b37c-d008-49ca-804e-62083458c79d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:35 devstack sudo[94460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.b854b37c-d008-49ca-804e-62083458c79d
Nov 07 02:35:35 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:35 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.b854b37c-d008-49ca-804e-62083458c79d" returned: 0 in 0.547s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:35:35 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[129166be-a372-40da-9a30-69ed3b2c3283]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:35 devstack sudo[94471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb
Nov 07 02:35:35 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:36 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb" returned: 0 in 0.419s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:35:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Creating direct copy from snapshot {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:35:36 devstack cinder-volume[87054]: DEBUG cinder.utils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Path /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-df13273c-9a35-49b1-bea1-72880f821c1c not found in is_blk_device check {{(pid=87054) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:35:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-df13273c-9a35-49b1-bea1-72880f821c1c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:36 devstack sudo[94476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-df13273c-9a35-49b1-bea1-72880f821c1c
Nov 07 02:35:36 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:44 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=17,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:35:45 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cc29bcd7-1984-4515-bc87-599c7ad4c14b tempest-VolumesActionsTest-262701735 None] Acquiring lock "cinder-16490fb7-a32e-40df-a0bf-a490ff837e5e" by "attach_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cc29bcd7-1984-4515-bc87-599c7ad4c14b tempest-VolumesActionsTest-262701735 None] Lock "cinder-16490fb7-a32e-40df-a0bf-a490ff837e5e" acquired by "attach_volume" :: waited 0.094s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:46 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-cc29bcd7-1984-4515-bc87-599c7ad4c14b tempest-VolumesActionsTest-262701735 None] Attaching volume 16490fb7-a32e-40df-a0bf-a490ff837e5e to instance a679f0eb-c61a-4a83-8705-ce0ee575ce3d at mountpoint /dev/vdb on host None.
Nov 07 02:35:46 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-cc29bcd7-1984-4515-bc87-599c7ad4c14b tempest-VolumesActionsTest-262701735 None] Attach volume completed successfully.
Nov 07 02:35:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cc29bcd7-1984-4515-bc87-599c7ad4c14b tempest-VolumesActionsTest-262701735 None] Lock "cinder-16490fb7-a32e-40df-a0bf-a490ff837e5e" released by "attach_volume" :: held 0.327s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-850d4ce6-de87-424d-9397-11729f05e6ff tempest-VolumesActionsTest-262701735 None] Acquiring lock "cinder-16490fb7-a32e-40df-a0bf-a490ff837e5e-detach_volume" by "detach_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-850d4ce6-de87-424d-9397-11729f05e6ff tempest-VolumesActionsTest-262701735 None] Lock "cinder-16490fb7-a32e-40df-a0bf-a490ff837e5e-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:47 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-850d4ce6-de87-424d-9397-11729f05e6ff tempest-VolumesActionsTest-262701735 None] Detaching volume 16490fb7-a32e-40df-a0bf-a490ff837e5e from instance a679f0eb-c61a-4a83-8705-ce0ee575ce3d.
Nov 07 02:35:47 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-850d4ce6-de87-424d-9397-11729f05e6ff tempest-VolumesActionsTest-262701735 None] Detach volume completed successfully.
Nov 07 02:35:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-850d4ce6-de87-424d-9397-11729f05e6ff tempest-VolumesActionsTest-262701735 None] Lock "cinder-16490fb7-a32e-40df-a0bf-a490ff837e5e-detach_volume" released by "detach_volume" :: held 0.249s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:47 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-df13273c-9a35-49b1-bea1-72880f821c1c" returned: 0 in 11.963s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:48 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Image conversion details: src /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb, size 1024.00 MB, duration 11.96 sec, destination /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-df13273c-9a35-49b1-bea1-72880f821c1c {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:35:48 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Converted 1024.00 MB image at 85.59 MB/s
Nov 07 02:35:48 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-df13273c-9a35-49b1-bea1-72880f821c1c is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:35:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-df13273c-9a35-49b1-bea1-72880f821c1c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:48 devstack sudo[94659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-df13273c-9a35-49b1-bea1-72880f821c1c
Nov 07 02:35:48 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:48 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-df13273c-9a35-49b1-bea1-72880f821c1c" returned: 0 in 0.250s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Lock "cinder-quobyte-df13273c-9a35-49b1-bea1-72880f821c1c" released by "_copy_volume_from_snapshot" :: held 13.357s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Acquiring lock "cinder-quobyte-b854b37c-d008-49ca-804e-62083458c79d" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Lock "cinder-quobyte-b854b37c-d008-49ca-804e-62083458c79d" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Deleting offline snapshot b854b37c-d008-49ca-804e-62083458c79d of volume 3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:35:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] snapshot_file for this snap is: volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.b854b37c-d008-49ca-804e-62083458c79d {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:35:48 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26a07b5-ad24-4367-a969-b4a8a01c672a]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.b854b37c-d008-49ca-804e-62083458c79d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:48 devstack sudo[94678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.b854b37c-d008-49ca-804e-62083458c79d
Nov 07 02:35:48 devstack sudo[94678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:48 devstack sudo[94678]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.b854b37c-d008-49ca-804e-62083458c79d" returned: 0 in 0.394s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:35:48 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab6d50e-5bb1-45ab-9cae-ab507f28aeb8]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:48 devstack sudo[94690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb
Nov 07 02:35:48 devstack sudo[94690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:49 devstack sudo[94690]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb" returned: 0 in 0.564s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.b854b37c-d008-49ca-804e-62083458c79d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:49 devstack sudo[94697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.b854b37c-d008-49ca-804e-62083458c79d
Nov 07 02:35:49 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:49 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.b854b37c-d008-49ca-804e-62083458c79d" returned: 0 in 0.370s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.b854b37c-d008-49ca-804e-62083458c79d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:49 devstack sudo[94702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.b854b37c-d008-49ca-804e-62083458c79d
Nov 07 02:35:49 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:50 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb.b854b37c-d008-49ca-804e-62083458c79d" returned: 0 in 0.245s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Lock "cinder-quobyte-b854b37c-d008-49ca-804e-62083458c79d" released by "_delete_snapshot" :: held 1.774s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.515s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:50 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-a2b59c0d-f4d9-4b5d-b58c-b8daed4f5dd3 tempest-GroupsV314Test-1830441425 None] Create group from source-group-939a157c-c36f-4c6d-bdc4-aa96790c0720 completed successfully.
Nov 07 02:35:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c53fb8cf-1d29-4483-a5ed-62bd94510fbc tempest-GroupsV314Test-1830441425 None] Acquiring lock "cinder-quobyte-df13273c-9a35-49b1-bea1-72880f821c1c" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c53fb8cf-1d29-4483-a5ed-62bd94510fbc tempest-GroupsV314Test-1830441425 None] Lock "cinder-quobyte-df13273c-9a35-49b1-bea1-72880f821c1c" acquired by "delete_volume" :: waited 0.029s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:50 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7cb943-52df-461a-b779-05124fe50be1]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c53fb8cf-1d29-4483-a5ed-62bd94510fbc tempest-GroupsV314Test-1830441425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-df13273c-9a35-49b1-bea1-72880f821c1c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:51 devstack sudo[94705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-df13273c-9a35-49b1-bea1-72880f821c1c
Nov 07 02:35:51 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:51 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c53fb8cf-1d29-4483-a5ed-62bd94510fbc tempest-GroupsV314Test-1830441425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-df13273c-9a35-49b1-bea1-72880f821c1c" returned: 0 in 0.514s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c53fb8cf-1d29-4483-a5ed-62bd94510fbc tempest-GroupsV314Test-1830441425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-df13273c-9a35-49b1-bea1-72880f821c1c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:51 devstack sudo[94712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-df13273c-9a35-49b1-bea1-72880f821c1c
Nov 07 02:35:51 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:51 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c53fb8cf-1d29-4483-a5ed-62bd94510fbc tempest-GroupsV314Test-1830441425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-df13273c-9a35-49b1-bea1-72880f821c1c" returned: 0 in 0.360s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c53fb8cf-1d29-4483-a5ed-62bd94510fbc tempest-GroupsV314Test-1830441425 None] Lock "cinder-quobyte-df13273c-9a35-49b1-bea1-72880f821c1c" released by "delete_volume" :: held 1.001s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:51 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-c53fb8cf-1d29-4483-a5ed-62bd94510fbc tempest-GroupsV314Test-1830441425 None] Created reservations ['e96a3205-ca26-4f6e-9319-c0b38a6c4190'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:35:51 devstack cinder-volume[87054]: WARNING cinder.quota [None req-c53fb8cf-1d29-4483-a5ed-62bd94510fbc tempest-GroupsV314Test-1830441425 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1773884253 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1773884253, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:35:51 devstack cinder-volume[87054]: WARNING cinder.quota [None req-c53fb8cf-1d29-4483-a5ed-62bd94510fbc tempest-GroupsV314Test-1830441425 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1773884253 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1773884253, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:35:51 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-c53fb8cf-1d29-4483-a5ed-62bd94510fbc tempest-GroupsV314Test-1830441425 None] Created reservations ['38b06e75-0984-4021-bd50-bd3b20bd193f', '1125852c-f71a-463e-acc8-264d0f80f179', 'e3cffcbf-726a-497e-8ad7-17ef506753fd', 'c12940d7-12a3-4a37-b3f5-cdc0e914984d'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:35:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c53fb8cf-1d29-4483-a5ed-62bd94510fbc tempest-GroupsV314Test-1830441425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c53fb8cf-1d29-4483-a5ed-62bd94510fbc tempest-GroupsV314Test-1830441425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c53fb8cf-1d29-4483-a5ed-62bd94510fbc tempest-GroupsV314Test-1830441425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:35:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c53fb8cf-1d29-4483-a5ed-62bd94510fbc tempest-GroupsV314Test-1830441425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:35:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c53fb8cf-1d29-4483-a5ed-62bd94510fbc tempest-GroupsV314Test-1830441425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c53fb8cf-1d29-4483-a5ed-62bd94510fbc tempest-GroupsV314Test-1830441425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:52 devstack sudo[94726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:35:52 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:52 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c53fb8cf-1d29-4483-a5ed-62bd94510fbc tempest-GroupsV314Test-1830441425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.451s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:52 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-c53fb8cf-1d29-4483-a5ed-62bd94510fbc tempest-GroupsV314Test-1830441425 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:35:52 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c53fb8cf-1d29-4483-a5ed-62bd94510fbc tempest-GroupsV314Test-1830441425 None] Delete group completed successfully.
Nov 07 02:35:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9b3aaa6a-bdf6-4aae-8fc6-26c8a83e68de tempest-GroupsV314Test-1830441425 None] Acquiring lock "cinder-quobyte-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:35:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9b3aaa6a-bdf6-4aae-8fc6-26c8a83e68de tempest-GroupsV314Test-1830441425 None] Lock "cinder-quobyte-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb" acquired by "delete_volume" :: waited 0.026s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:35:52 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[8198ff30-9227-458d-b456-2a7ec6080949]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9b3aaa6a-bdf6-4aae-8fc6-26c8a83e68de tempest-GroupsV314Test-1830441425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:52 devstack sudo[94743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb
Nov 07 02:35:52 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d056337f-584e-4bcb-b85f-14e407ba7b5f tempest-VolumesActionsTest-262701735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d056337f-584e-4bcb-b85f-14e407ba7b5f tempest-VolumesActionsTest-262701735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:53 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceff703a-1bb7-4321-ab56-2494ae077648]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d056337f-584e-4bcb-b85f-14e407ba7b5f tempest-VolumesActionsTest-262701735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:53 devstack sudo[94745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e
Nov 07 02:35:53 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:53 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9b3aaa6a-bdf6-4aae-8fc6-26c8a83e68de tempest-GroupsV314Test-1830441425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb" returned: 0 in 0.450s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9b3aaa6a-bdf6-4aae-8fc6-26c8a83e68de tempest-GroupsV314Test-1830441425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:53 devstack sudo[94750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb
Nov 07 02:35:53 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:53 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:53 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9b3aaa6a-bdf6-4aae-8fc6-26c8a83e68de tempest-GroupsV314Test-1830441425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb" returned: 0 in 0.296s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d056337f-584e-4bcb-b85f-14e407ba7b5f tempest-VolumesActionsTest-262701735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e" returned: 0 in 0.469s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9b3aaa6a-bdf6-4aae-8fc6-26c8a83e68de tempest-GroupsV314Test-1830441425 None] Lock "cinder-quobyte-3c95b8cb-2bb8-4710-9469-a5b2bebb0aeb" released by "delete_volume" :: held 0.841s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:35:53 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4a1b09-33a5-470a-924e-591c2fbe8120]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:35:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d056337f-584e-4bcb-b85f-14e407ba7b5f tempest-VolumesActionsTest-262701735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:53 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-9b3aaa6a-bdf6-4aae-8fc6-26c8a83e68de tempest-GroupsV314Test-1830441425 None] Created reservations ['c9ea03e8-1e9f-4acb-998d-18d90758e4a3'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:35:53 devstack sudo[94759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e
Nov 07 02:35:53 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:53 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-9b3aaa6a-bdf6-4aae-8fc6-26c8a83e68de tempest-GroupsV314Test-1830441425 None] Created reservations ['51aa1be9-7ce9-4506-838f-16adbf133a08', '695df48b-6c06-4409-a251-649ea304da96', 'b002c18f-8f68-4743-bff1-45332d2578f1', '9f11d5c0-669a-4365-bfb4-752ad11e9d49'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:35:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9b3aaa6a-bdf6-4aae-8fc6-26c8a83e68de tempest-GroupsV314Test-1830441425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9b3aaa6a-bdf6-4aae-8fc6-26c8a83e68de tempest-GroupsV314Test-1830441425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9b3aaa6a-bdf6-4aae-8fc6-26c8a83e68de tempest-GroupsV314Test-1830441425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:35:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9b3aaa6a-bdf6-4aae-8fc6-26c8a83e68de tempest-GroupsV314Test-1830441425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:35:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9b3aaa6a-bdf6-4aae-8fc6-26c8a83e68de tempest-GroupsV314Test-1830441425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9b3aaa6a-bdf6-4aae-8fc6-26c8a83e68de tempest-GroupsV314Test-1830441425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:53 devstack sudo[94796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:35:53 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:54 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d056337f-584e-4bcb-b85f-14e407ba7b5f tempest-VolumesActionsTest-262701735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e" returned: 0 in 0.652s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d056337f-584e-4bcb-b85f-14e407ba7b5f tempest-VolumesActionsTest-262701735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e /opt/stack/data/cinder/conversion/16490fb7-a32e-40df-a0bf-a490ff837e5e.temp_image.4640706d-a703-42bc-b49c-b9bef233f43bm598vdyl.img {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:54 devstack sudo[94804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e /opt/stack/data/cinder/conversion/16490fb7-a32e-40df-a0bf-a490ff837e5e.temp_image.4640706d-a703-42bc-b49c-b9bef233f43bm598vdyl.img
Nov 07 02:35:54 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:54 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9b3aaa6a-bdf6-4aae-8fc6-26c8a83e68de tempest-GroupsV314Test-1830441425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.389s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:54 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-9b3aaa6a-bdf6-4aae-8fc6-26c8a83e68de tempest-GroupsV314Test-1830441425 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:35:54 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-9b3aaa6a-bdf6-4aae-8fc6-26c8a83e68de tempest-GroupsV314Test-1830441425 None] Delete group completed successfully.
Nov 07 02:35:58 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-0adfeee9-b74b-4488-b4f7-26cd4ef98776 req-42d283da-e36b-4dac-b29c-4e539ded7eda tempest-AttachVolumeNegativeTest-1758341388 None] Terminate volume connection completed successfully.
Nov 07 02:35:58 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-0adfeee9-b74b-4488-b4f7-26cd4ef98776 req-42d283da-e36b-4dac-b29c-4e539ded7eda tempest-AttachVolumeNegativeTest-1758341388 None] Deleting attachment 2867e01b-06b4-49d9-aa3e-8026ad17f470. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:35:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:35:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:35:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:35:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:35:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:35:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:35:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:35:59 devstack sudo[94823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:35:59 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:35:59 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root
Nov 07 02:35:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.688s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:35:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:35:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:35:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 28 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:35:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>, <Thread(fd_logger, started daemon 125443282798592)>, <Thread(privsep_reader, started daemon 125443284556288)>, <Thread(tpool_thread_0, started daemon 125443276445376)>, <Thread(tpool_thread_1, started daemon 125443268036288)>, <Thread(tpool_thread_2, started daemon 125443259627200)>, <Thread(tpool_thread_3, started daemon 125443251218112)>, <Thread(tpool_thread_4, started daemon 125443242809024)>, <Thread(tpool_thread_5, started daemon 125443234399936)>, <Thread(tpool_thread_6, started daemon 125443225990848)>, <Thread(tpool_thread_7, started daemon 125443217581760)>, <Thread(tpool_thread_8, started daemon 125443209172672)>, <Thread(tpool_thread_9, started daemon 125443200763584)>, <Thread(tpool_thread_10, started daemon 125443192354496)>, <Thread(tpool_thread_11, started daemon 125443183945408)>, <Thread(tpool_thread_12, started daemon 125443175536320)>, <Thread(tpool_thread_13, started daemon 125443167127232)>, <Thread(tpool_thread_14, started daemon 125443158718144)>, <Thread(tpool_thread_15, started daemon 125443150309056)>, <Thread(tpool_thread_16, started daemon 125443141899968)>, <Thread(tpool_thread_17, started daemon 125443133490880)>, <Thread(tpool_thread_18, started daemon 125443125081792)>, <Thread(tpool_thread_19, started daemon 125443116672704)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:36:02 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d056337f-584e-4bcb-b85f-14e407ba7b5f tempest-VolumesActionsTest-262701735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e /opt/stack/data/cinder/conversion/16490fb7-a32e-40df-a0bf-a490ff837e5e.temp_image.4640706d-a703-42bc-b49c-b9bef233f43bm598vdyl.img" returned: 0 in 8.284s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:02 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bf0590-9aa8-450a-a869-f42a3e8d3364]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:36:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d056337f-584e-4bcb-b85f-14e407ba7b5f tempest-VolumesActionsTest-262701735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:02 devstack sudo[94852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e
Nov 07 02:36:02 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:03 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d056337f-584e-4bcb-b85f-14e407ba7b5f tempest-VolumesActionsTest-262701735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e" returned: 0 in 0.633s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:03 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-d056337f-584e-4bcb-b85f-14e407ba7b5f tempest-VolumesActionsTest-262701735 None] Image conversion details: src /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e, size 1024.00 MB, duration 8.29 sec, destination /opt/stack/data/cinder/conversion/16490fb7-a32e-40df-a0bf-a490ff837e5e.temp_image.4640706d-a703-42bc-b49c-b9bef233f43bm598vdyl.img {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:36:03 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-d056337f-584e-4bcb-b85f-14e407ba7b5f tempest-VolumesActionsTest-262701735 None] Converted 1024.00 MB image at 123.51 MB/s
Nov 07 02:36:03 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-d056337f-584e-4bcb-b85f-14e407ba7b5f tempest-VolumesActionsTest-262701735 None] 4640706d-a703-42bc-b49c-b9bef233f43b was raw, no need to convert to raw {{(pid=87054) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 07 02:36:04 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-3f291d5e-9c75-4223-b875-b68c4fd88c39 tempest-GroupsV320Test-1191445533 None] Group tempest-GroupsV320Test-Group-1061518222: creating
Nov 07 02:36:04 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-3f291d5e-9c75-4223-b875-b68c4fd88c39 tempest-GroupsV320Test-1191445533 None] Group tempest-GroupsV320Test-Group-1061518222: created successfully
Nov 07 02:36:04 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-3f291d5e-9c75-4223-b875-b68c4fd88c39 tempest-GroupsV320Test-1191445533 None] Create group completed successfully.
Nov 07 02:36:06 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-ae1d894d-f750-4e2e-b3bf-07945753bf84 tempest-GroupsV320Test-1191445533 None] Created reservations ['f36d9181-4463-4264-8d0c-5a63e867d9ba'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:36:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ae1d894d-f750-4e2e-b3bf-07945753bf84 tempest-GroupsV320Test-1191445533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ae1d894d-f750-4e2e-b3bf-07945753bf84 tempest-GroupsV320Test-1191445533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ae1d894d-f750-4e2e-b3bf-07945753bf84 tempest-GroupsV320Test-1191445533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:36:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ae1d894d-f750-4e2e-b3bf-07945753bf84 tempest-GroupsV320Test-1191445533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:36:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ae1d894d-f750-4e2e-b3bf-07945753bf84 tempest-GroupsV320Test-1191445533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ae1d894d-f750-4e2e-b3bf-07945753bf84 tempest-GroupsV320Test-1191445533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:06 devstack sudo[94858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:36:06 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:06 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ae1d894d-f750-4e2e-b3bf-07945753bf84 tempest-GroupsV320Test-1191445533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.392s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:06 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-ae1d894d-f750-4e2e-b3bf-07945753bf84 tempest-GroupsV320Test-1191445533 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:36:06 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ae1d894d-f750-4e2e-b3bf-07945753bf84 tempest-GroupsV320Test-1191445533 None] Delete group completed successfully.
Nov 07 02:36:13 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-38de0586-3842-418e-8986-7d0e06b3f17f tempest-AttachVolumeShelveTestJSON-365168603 None] Acquiring lock "cinder-5522e9f8-b14b-4259-bd81-e191b73e3216-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:13 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-38de0586-3842-418e-8986-7d0e06b3f17f tempest-AttachVolumeShelveTestJSON-365168603 None] Lock "cinder-5522e9f8-b14b-4259-bd81-e191b73e3216-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:13 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-38de0586-3842-418e-8986-7d0e06b3f17f tempest-AttachVolumeShelveTestJSON-365168603 None] Acquiring lock "cinder-quobyte-5522e9f8-b14b-4259-bd81-e191b73e3216" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:13 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-38de0586-3842-418e-8986-7d0e06b3f17f tempest-AttachVolumeShelveTestJSON-365168603 None] Lock "cinder-quobyte-5522e9f8-b14b-4259-bd81-e191b73e3216" acquired by "delete_volume" :: waited 0.026s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:13 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1f288e-b056-4b7d-9fc5-cd3adb599b54]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:36:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38de0586-3842-418e-8986-7d0e06b3f17f tempest-AttachVolumeShelveTestJSON-365168603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5522e9f8-b14b-4259-bd81-e191b73e3216 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:13 devstack sudo[94898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5522e9f8-b14b-4259-bd81-e191b73e3216
Nov 07 02:36:13 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:14 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38de0586-3842-418e-8986-7d0e06b3f17f tempest-AttachVolumeShelveTestJSON-365168603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5522e9f8-b14b-4259-bd81-e191b73e3216" returned: 0 in 0.734s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38de0586-3842-418e-8986-7d0e06b3f17f tempest-AttachVolumeShelveTestJSON-365168603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5522e9f8-b14b-4259-bd81-e191b73e3216 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:14 devstack sudo[94921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5522e9f8-b14b-4259-bd81-e191b73e3216
Nov 07 02:36:14 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:14 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38de0586-3842-418e-8986-7d0e06b3f17f tempest-AttachVolumeShelveTestJSON-365168603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5522e9f8-b14b-4259-bd81-e191b73e3216" returned: 0 in 0.482s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:14 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-38de0586-3842-418e-8986-7d0e06b3f17f tempest-AttachVolumeShelveTestJSON-365168603 None] Lock "cinder-quobyte-5522e9f8-b14b-4259-bd81-e191b73e3216" released by "delete_volume" :: held 1.295s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:14 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-38de0586-3842-418e-8986-7d0e06b3f17f tempest-AttachVolumeShelveTestJSON-365168603 None] Created reservations ['63fc9f60-69a3-4c42-b0f8-949e6d75c18f', '91ada2e3-dcef-4d33-a04c-c1b03eee4412', '1fcb78bd-c052-40e3-a63a-be28dcb05466', 'c33ae533-c33b-4072-b650-a022d1c5f0ec'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:36:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-38de0586-3842-418e-8986-7d0e06b3f17f tempest-AttachVolumeShelveTestJSON-365168603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-38de0586-3842-418e-8986-7d0e06b3f17f tempest-AttachVolumeShelveTestJSON-365168603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-38de0586-3842-418e-8986-7d0e06b3f17f tempest-AttachVolumeShelveTestJSON-365168603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:36:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-38de0586-3842-418e-8986-7d0e06b3f17f tempest-AttachVolumeShelveTestJSON-365168603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:36:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-38de0586-3842-418e-8986-7d0e06b3f17f tempest-AttachVolumeShelveTestJSON-365168603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38de0586-3842-418e-8986-7d0e06b3f17f tempest-AttachVolumeShelveTestJSON-365168603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:15 devstack sudo[94926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:36:15 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:15 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38de0586-3842-418e-8986-7d0e06b3f17f tempest-AttachVolumeShelveTestJSON-365168603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.424s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:15 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-38de0586-3842-418e-8986-7d0e06b3f17f tempest-AttachVolumeShelveTestJSON-365168603 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:36:15 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-38de0586-3842-418e-8986-7d0e06b3f17f tempest-AttachVolumeShelveTestJSON-365168603 None] Deleted volume successfully.
Nov 07 02:36:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-38de0586-3842-418e-8986-7d0e06b3f17f tempest-AttachVolumeShelveTestJSON-365168603 None] Lock "cinder-5522e9f8-b14b-4259-bd81-e191b73e3216-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:25 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=49,cinder:INSERT=12,cinder:UPDATE=50 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:36:25 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=43,cinder:INSERT=8,cinder:UPDATE=35,cinder:DELETE=1 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Flow 'volume_create_manager' (83e14ac2-42ad-4e11-a46a-eb859b85e965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334a83f8-8135-4a8a-b451-95de653e0a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334a83f8-8135-4a8a-b451-95de653e0a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-41574789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3286c8de-ce99-42cc-902b-c67698c353b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de1c9afc6b44887beb08744934586f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:36:34Z,use_quota=True,user_id='38dab7842ff24ef6957dda137d5aeef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bad3d3-a368-4375-abf6-a13914e50ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bad3d3-a368-4375-abf6-a13914e50ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf8b939-26af-4721-a08a-27adf2ef22ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf8b939-26af-4721-a08a-27adf2ef22ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3286c8de-ce99-42cc-902b-c67698c353b6', 'volume_name': 'volume-3286c8de-ce99-42cc-902b-c67698c353b6', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ec7c34-3fbc-4d5c-a580-6391ca9976a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ec7c34-3fbc-4d5c-a580-6391ca9976a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec98c82c-4f75-41dc-8eeb-8ccc0b2a99f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:34 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Volume 3286c8de-ce99-42cc-902b-c67698c353b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3286c8de-ce99-42cc-902b-c67698c353b6', 'volume_size': 1}
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d056337f-584e-4bcb-b85f-14e407ba7b5f tempest-VolumesActionsTest-262701735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 41.521s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d056337f-584e-4bcb-b85f-14e407ba7b5f tempest-VolumesActionsTest-262701735 None] Uploaded volume to glance image-id: 4640706d-a703-42bc-b49c-b9bef233f43b. {{(pid=87054) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.164s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-41574789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3286c8de-ce99-42cc-902b-c67698c353b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de1c9afc6b44887beb08744934586f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:36:34Z,use_quota=True,user_id='38dab7842ff24ef6957dda137d5aeef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Creating volume 3286c8de-ce99-42cc-902b-c67698c353b6 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:36:34 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:36:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3286c8de-ce99-42cc-902b-c67698c353b6 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:34 devstack sudo[95050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3286c8de-ce99-42cc-902b-c67698c353b6 1073741824
Nov 07 02:36:34 devstack sudo[95050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:34 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-d056337f-584e-4bcb-b85f-14e407ba7b5f tempest-VolumesActionsTest-262701735 None] Copy volume to image completed successfully.
Nov 07 02:36:35 devstack sudo[95050]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3286c8de-ce99-42cc-902b-c67698c353b6 1073741824" returned: 0 in 0.568s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3286c8de-ce99-42cc-902b-c67698c353b6 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:35 devstack sudo[95056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3286c8de-ce99-42cc-902b-c67698c353b6
Nov 07 02:36:35 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:35 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3286c8de-ce99-42cc-902b-c67698c353b6" returned: 0 in 0.304s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:36:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec98c82c-4f75-41dc-8eeb-8ccc0b2a99f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3286c8de-ce99-42cc-902b-c67698c353b6', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f980636f-29f2-44ec-8e35-7b075366686e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:35 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Volume volume-3286c8de-ce99-42cc-902b-c67698c353b6 (3286c8de-ce99-42cc-902b-c67698c353b6): created successfully
Nov 07 02:36:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f980636f-29f2-44ec-8e35-7b075366686e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Flow 'volume_create_manager' (83e14ac2-42ad-4e11-a46a-eb859b85e965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:36:35 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-7d70c0d3-e191-4484-9326-cf35d824f627 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Created volume successfully.
Nov 07 02:36:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:36 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa0c4dd-b319-4e6c-9c71-9ca1f219660d]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:36:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:36 devstack sudo[95059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e
Nov 07 02:36:36 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:36 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e" returned: 0 in 0.427s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:36 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[d716e6d8-e8cc-487b-a39f-d9bf755f7f3b]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:36:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:37 devstack sudo[95065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e
Nov 07 02:36:37 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:37 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e" returned: 0 in 0.393s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e /opt/stack/data/cinder/conversion/16490fb7-a32e-40df-a0bf-a490ff837e5e.temp_image.5a99cc41-dc10-4076-9fa8-88f46cb9cbd1cvz8i59y.img {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:37 devstack sudo[95071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e /opt/stack/data/cinder/conversion/16490fb7-a32e-40df-a0bf-a490ff837e5e.temp_image.5a99cc41-dc10-4076-9fa8-88f46cb9cbd1cvz8i59y.img
Nov 07 02:36:37 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b9ee70d3-1aaa-4a12-afc4-7d2b57443a27 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Acquiring lock "cinder-3286c8de-ce99-42cc-902b-c67698c353b6-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b9ee70d3-1aaa-4a12-afc4-7d2b57443a27 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Lock "cinder-3286c8de-ce99-42cc-902b-c67698c353b6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b9ee70d3-1aaa-4a12-afc4-7d2b57443a27 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Acquiring lock "cinder-quobyte-3286c8de-ce99-42cc-902b-c67698c353b6" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b9ee70d3-1aaa-4a12-afc4-7d2b57443a27 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Lock "cinder-quobyte-3286c8de-ce99-42cc-902b-c67698c353b6" acquired by "delete_volume" :: waited 0.030s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:37 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bc64d6-3749-4b42-bc61-c9d5559d5e1b]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:36:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9ee70d3-1aaa-4a12-afc4-7d2b57443a27 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3286c8de-ce99-42cc-902b-c67698c353b6 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:38 devstack sudo[95084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3286c8de-ce99-42cc-902b-c67698c353b6
Nov 07 02:36:38 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:38 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9ee70d3-1aaa-4a12-afc4-7d2b57443a27 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3286c8de-ce99-42cc-902b-c67698c353b6" returned: 0 in 0.721s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9ee70d3-1aaa-4a12-afc4-7d2b57443a27 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3286c8de-ce99-42cc-902b-c67698c353b6 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:38 devstack sudo[95089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3286c8de-ce99-42cc-902b-c67698c353b6
Nov 07 02:36:38 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:39 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9ee70d3-1aaa-4a12-afc4-7d2b57443a27 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3286c8de-ce99-42cc-902b-c67698c353b6" returned: 0 in 0.723s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:39 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b9ee70d3-1aaa-4a12-afc4-7d2b57443a27 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Lock "cinder-quobyte-3286c8de-ce99-42cc-902b-c67698c353b6" released by "delete_volume" :: held 1.562s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:39 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-b9ee70d3-1aaa-4a12-afc4-7d2b57443a27 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Created reservations ['17954df0-67af-46f9-be88-ae1be1a59fcb', '228e41c6-acd2-4513-af1e-7b09537bfc10', '18ad0fb0-ffee-4118-9a53-6fe992fad572', 'cc2c5ef0-f0ca-48d5-85d5-257c38584d31'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:36:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b9ee70d3-1aaa-4a12-afc4-7d2b57443a27 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b9ee70d3-1aaa-4a12-afc4-7d2b57443a27 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b9ee70d3-1aaa-4a12-afc4-7d2b57443a27 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:36:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b9ee70d3-1aaa-4a12-afc4-7d2b57443a27 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:36:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b9ee70d3-1aaa-4a12-afc4-7d2b57443a27 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9ee70d3-1aaa-4a12-afc4-7d2b57443a27 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:40 devstack sudo[95095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:36:40 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:40 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9ee70d3-1aaa-4a12-afc4-7d2b57443a27 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.864s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:40 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-b9ee70d3-1aaa-4a12-afc4-7d2b57443a27 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:36:40 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b9ee70d3-1aaa-4a12-afc4-7d2b57443a27 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Deleted volume successfully.
Nov 07 02:36:41 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b9ee70d3-1aaa-4a12-afc4-7d2b57443a27 tempest-VolumeQuotasNegativeTestJSON-1810216882 None] Lock "cinder-3286c8de-ce99-42cc-902b-c67698c353b6-delete_volume" released by "delete_volume" :: held 3.259s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:44 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:36:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Flow 'volume_create_manager' (cb684948-267c-4406-ad3d-969676786275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:36:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5885f2fb-7acf-4ad1-856e-e6195dc9d500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5885f2fb-7acf-4ad1-856e-e6195dc9d500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-975086493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5449b709-cfc5-4b95-9bca-a7094ff6c2cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30ae1aab583410aa3de4619434d50bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:36:44Z,use_quota=True,user_id='5eaa9870c80548608ef49030140e600d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6300361c-665e-465b-ada6-731912fb1ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6300361c-665e-465b-ada6-731912fb1ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e813208a-bf6d-47ca-90e6-75dd32a5e9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e813208a-bf6d-47ca-90e6-75dd32a5e9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5449b709-cfc5-4b95-9bca-a7094ff6c2cc', 'volume_name': 'volume-5449b709-cfc5-4b95-9bca-a7094ff6c2cc', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e56023-f924-40ae-a64d-0eef5b5213d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e56023-f924-40ae-a64d-0eef5b5213d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2ad7a9-c23e-4048-9ad7-e2adafc0e188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:44 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Volume 5449b709-cfc5-4b95-9bca-a7094ff6c2cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5449b709-cfc5-4b95-9bca-a7094ff6c2cc', 'volume_size': 1}
Nov 07 02:36:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e /opt/stack/data/cinder/conversion/16490fb7-a32e-40df-a0bf-a490ff837e5e.temp_image.5a99cc41-dc10-4076-9fa8-88f46cb9cbd1cvz8i59y.img" returned: 0 in 9.778s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:47 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[816f5d68-134a-44de-ab3d-736e3bbc83d9]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:36:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:47 devstack sudo[95109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e
Nov 07 02:36:47 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:47 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e" returned: 0 in 0.573s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:47 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] Image conversion details: src /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e, size 1024.00 MB, duration 9.78 sec, destination /opt/stack/data/cinder/conversion/16490fb7-a32e-40df-a0bf-a490ff837e5e.temp_image.5a99cc41-dc10-4076-9fa8-88f46cb9cbd1cvz8i59y.img {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:36:47 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] Converted 1024.00 MB image at 104.71 MB/s
Nov 07 02:36:47 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] 5a99cc41-dc10-4076-9fa8-88f46cb9cbd1 was raw, converting to qcow2 {{(pid=87054) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Nov 07 02:36:47 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ec47ab-dbdd-48bd-942c-9fed2dec280b]: (4, 'raw') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:36:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/16490fb7-a32e-40df-a0bf-a490ff837e5e.temp_image.5a99cc41-dc10-4076-9fa8-88f46cb9cbd1cvz8i59y.img {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:47 devstack sudo[95115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/16490fb7-a32e-40df-a0bf-a490ff837e5e.temp_image.5a99cc41-dc10-4076-9fa8-88f46cb9cbd1cvz8i59y.img
Nov 07 02:36:47 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:48 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/16490fb7-a32e-40df-a0bf-a490ff837e5e.temp_image.5a99cc41-dc10-4076-9fa8-88f46cb9cbd1cvz8i59y.img" returned: 0 in 0.359s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/16490fb7-a32e-40df-a0bf-a490ff837e5e.temp_image.5a99cc41-dc10-4076-9fa8-88f46cb9cbd1cvz8i59y.img {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:48 devstack sudo[95119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/16490fb7-a32e-40df-a0bf-a490ff837e5e.temp_image.5a99cc41-dc10-4076-9fa8-88f46cb9cbd1cvz8i59y.img
Nov 07 02:36:48 devstack sudo[95119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:48 devstack sudo[95119]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/16490fb7-a32e-40df-a0bf-a490ff837e5e.temp_image.5a99cc41-dc10-4076-9fa8-88f46cb9cbd1cvz8i59y.img" returned: 1 in 0.411s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/16490fb7-a32e-40df-a0bf-a490ff837e5e.temp_image.5a99cc41-dc10-4076-9fa8-88f46cb9cbd1cvz8i59y.img' failed. Not Retrying. {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:36:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/16490fb7-a32e-40df-a0bf-a490ff837e5e.temp_image.5a99cc41-dc10-4076-9fa8-88f46cb9cbd1cvz8i59y.img /opt/stack/data/cinder/conversion/vol_upload_2h6xenfd {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:48 devstack sudo[95124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/16490fb7-a32e-40df-a0bf-a490ff837e5e.temp_image.5a99cc41-dc10-4076-9fa8-88f46cb9cbd1cvz8i59y.img /opt/stack/data/cinder/conversion/vol_upload_2h6xenfd
Nov 07 02:36:48 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:48 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/16490fb7-a32e-40df-a0bf-a490ff837e5e.temp_image.5a99cc41-dc10-4076-9fa8-88f46cb9cbd1cvz8i59y.img /opt/stack/data/cinder/conversion/vol_upload_2h6xenfd" returned: 0 in 0.269s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:48 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] Image conversion details: src /opt/stack/data/cinder/conversion/16490fb7-a32e-40df-a0bf-a490ff837e5e.temp_image.5a99cc41-dc10-4076-9fa8-88f46cb9cbd1cvz8i59y.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_2h6xenfd {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:36:48 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] Converted 1024.00 MB image at 1024.00 MB/s
Nov 07 02:36:48 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb04fca-797f-4731-91d3-1722111d3ce7]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:36:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2h6xenfd {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:48 devstack sudo[95130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2h6xenfd
Nov 07 02:36:48 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:49 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2h6xenfd" returned: 0 in 0.352s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.545s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:51 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] Uploaded volume to glance image-id: 5a99cc41-dc10-4076-9fa8-88f46cb9cbd1. {{(pid=87054) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 07 02:36:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.765s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:51 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-975086493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5449b709-cfc5-4b95-9bca-a7094ff6c2cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30ae1aab583410aa3de4619434d50bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:36:44Z,use_quota=True,user_id='5eaa9870c80548608ef49030140e600d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:36:51 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Creating volume 5449b709-cfc5-4b95-9bca-a7094ff6c2cc {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:36:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:51 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:36:51 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:36:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:51 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:36:51 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:36:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5449b709-cfc5-4b95-9bca-a7094ff6c2cc 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:51 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-548ed56f-eea7-4e50-8cef-d961cd1f6475 tempest-VolumesActionsTest-262701735 None] Copy volume to image completed successfully.
Nov 07 02:36:51 devstack sudo[95138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5449b709-cfc5-4b95-9bca-a7094ff6c2cc 1073741824
Nov 07 02:36:51 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:51 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5449b709-cfc5-4b95-9bca-a7094ff6c2cc 1073741824" returned: 0 in 0.596s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5449b709-cfc5-4b95-9bca-a7094ff6c2cc {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:51 devstack sudo[95145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5449b709-cfc5-4b95-9bca-a7094ff6c2cc
Nov 07 02:36:51 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:52 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5449b709-cfc5-4b95-9bca-a7094ff6c2cc" returned: 0 in 0.442s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:36:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:52 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2ad7a9-c23e-4048-9ad7-e2adafc0e188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5449b709-cfc5-4b95-9bca-a7094ff6c2cc', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:52 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa33a86-9270-486a-84f7-465491443bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:36:52 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Volume volume-5449b709-cfc5-4b95-9bca-a7094ff6c2cc (5449b709-cfc5-4b95-9bca-a7094ff6c2cc): created successfully
Nov 07 02:36:52 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa33a86-9270-486a-84f7-465491443bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:36:52 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Flow 'volume_create_manager' (cb684948-267c-4406-ad3d-969676786275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:36:52 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-6f9fd3e4-7f7e-42ca-99f1-664ebd743099 tempest-AttachVolumeNegativeTest-1758341388 None] Created volume successfully.
Nov 07 02:36:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ac4b8d54-2882-434f-94dc-98f8435c2d37 tempest-VolumesActionsTest-262701735 None] Acquiring lock "cinder-16490fb7-a32e-40df-a0bf-a490ff837e5e-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ac4b8d54-2882-434f-94dc-98f8435c2d37 tempest-VolumesActionsTest-262701735 None] Lock "cinder-16490fb7-a32e-40df-a0bf-a490ff837e5e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ac4b8d54-2882-434f-94dc-98f8435c2d37 tempest-VolumesActionsTest-262701735 None] Acquiring lock "cinder-quobyte-16490fb7-a32e-40df-a0bf-a490ff837e5e" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:36:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ac4b8d54-2882-434f-94dc-98f8435c2d37 tempest-VolumesActionsTest-262701735 None] Lock "cinder-quobyte-16490fb7-a32e-40df-a0bf-a490ff837e5e" acquired by "delete_volume" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:36:52 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fc5528-2610-427a-a4e9-7a1e1d174695]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:36:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac4b8d54-2882-434f-94dc-98f8435c2d37 tempest-VolumesActionsTest-262701735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:52 devstack sudo[95148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e
Nov 07 02:36:52 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:52 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac4b8d54-2882-434f-94dc-98f8435c2d37 tempest-VolumesActionsTest-262701735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e" returned: 0 in 0.555s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac4b8d54-2882-434f-94dc-98f8435c2d37 tempest-VolumesActionsTest-262701735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:52 devstack sudo[95159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e
Nov 07 02:36:52 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:53 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac4b8d54-2882-434f-94dc-98f8435c2d37 tempest-VolumesActionsTest-262701735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-16490fb7-a32e-40df-a0bf-a490ff837e5e" returned: 0 in 0.419s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ac4b8d54-2882-434f-94dc-98f8435c2d37 tempest-VolumesActionsTest-262701735 None] Lock "cinder-quobyte-16490fb7-a32e-40df-a0bf-a490ff837e5e" released by "delete_volume" :: held 1.047s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:53 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-ac4b8d54-2882-434f-94dc-98f8435c2d37 tempest-VolumesActionsTest-262701735 None] Created reservations ['9cce3088-2ffd-42cf-8942-6299c5d828f6', 'aae0774b-5d21-4680-9399-7941267045c2', '11877458-b8cd-45bf-a13f-37e7941529db', '17372b40-9485-4cfd-aa4a-74b55aba092d'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:36:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ac4b8d54-2882-434f-94dc-98f8435c2d37 tempest-VolumesActionsTest-262701735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ac4b8d54-2882-434f-94dc-98f8435c2d37 tempest-VolumesActionsTest-262701735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ac4b8d54-2882-434f-94dc-98f8435c2d37 tempest-VolumesActionsTest-262701735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:36:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ac4b8d54-2882-434f-94dc-98f8435c2d37 tempest-VolumesActionsTest-262701735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:36:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ac4b8d54-2882-434f-94dc-98f8435c2d37 tempest-VolumesActionsTest-262701735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac4b8d54-2882-434f-94dc-98f8435c2d37 tempest-VolumesActionsTest-262701735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:53 devstack sudo[95178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:36:53 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:53 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac4b8d54-2882-434f-94dc-98f8435c2d37 tempest-VolumesActionsTest-262701735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.348s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:53 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-ac4b8d54-2882-434f-94dc-98f8435c2d37 tempest-VolumesActionsTest-262701735 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:36:53 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ac4b8d54-2882-434f-94dc-98f8435c2d37 tempest-VolumesActionsTest-262701735 None] Deleted volume successfully.
Nov 07 02:36:54 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ac4b8d54-2882-434f-94dc-98f8435c2d37 tempest-VolumesActionsTest-262701735 None] Lock "cinder-16490fb7-a32e-40df-a0bf-a490ff837e5e-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:36:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-68b0e7da-3840-4b30-8f9e-ea8e0f13bc70 req-cb68077e-acb7-42fe-b23d-05e82ee3d314 tempest-AttachVolumeNegativeTest-1758341388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-68b0e7da-3840-4b30-8f9e-ea8e0f13bc70 req-cb68077e-acb7-42fe-b23d-05e82ee3d314 tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-68b0e7da-3840-4b30-8f9e-ea8e0f13bc70 req-cb68077e-acb7-42fe-b23d-05e82ee3d314 tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-68b0e7da-3840-4b30-8f9e-ea8e0f13bc70 req-cb68077e-acb7-42fe-b23d-05e82ee3d314 tempest-AttachVolumeNegativeTest-1758341388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c', 'name': 'volume-5449b709-cfc5-4b95-9bca-a7094ff6c2cc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd7ec4091-eb11-4a99-bb18-d35c9da5574c', 'enforce_multipath': True} {{(pid=87054) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:36:54 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-68b0e7da-3840-4b30-8f9e-ea8e0f13bc70 req-cb68077e-acb7-42fe-b23d-05e82ee3d314 tempest-AttachVolumeNegativeTest-1758341388 None] attachment_update completed successfully.
Nov 07 02:36:58 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-20271520-1613-4cf4-b490-f2364965cd47 req-64f6aaae-d955-4cd7-9b0d-0ed257ec1426 tempest-AttachVolumeNegativeTest-1758341388 None] Terminate volume connection completed successfully.
Nov 07 02:36:58 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-20271520-1613-4cf4-b490-f2364965cd47 req-64f6aaae-d955-4cd7-9b0d-0ed257ec1426 tempest-AttachVolumeNegativeTest-1758341388 None] Deleting attachment d7ec4091-eb11-4a99-bb18-d35c9da5574c. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:36:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:36:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:36:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:36:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:36:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:36:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:36:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:36:59 devstack sudo[95745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:36:59 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:36:59 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root
Nov 07 02:36:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.741s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:36:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:36:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:36:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 28 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:36:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>, <Thread(fd_logger, started daemon 125443282798592)>, <Thread(privsep_reader, started daemon 125443284556288)>, <Thread(tpool_thread_0, started daemon 125443276445376)>, <Thread(tpool_thread_1, started daemon 125443268036288)>, <Thread(tpool_thread_2, started daemon 125443259627200)>, <Thread(tpool_thread_3, started daemon 125443251218112)>, <Thread(tpool_thread_4, started daemon 125443242809024)>, <Thread(tpool_thread_5, started daemon 125443234399936)>, <Thread(tpool_thread_6, started daemon 125443225990848)>, <Thread(tpool_thread_7, started daemon 125443217581760)>, <Thread(tpool_thread_8, started daemon 125443209172672)>, <Thread(tpool_thread_9, started daemon 125443200763584)>, <Thread(tpool_thread_10, started daemon 125443192354496)>, <Thread(tpool_thread_11, started daemon 125443183945408)>, <Thread(tpool_thread_12, started daemon 125443175536320)>, <Thread(tpool_thread_13, started daemon 125443167127232)>, <Thread(tpool_thread_14, started daemon 125443158718144)>, <Thread(tpool_thread_15, started daemon 125443150309056)>, <Thread(tpool_thread_16, started daemon 125443141899968)>, <Thread(tpool_thread_17, started daemon 125443133490880)>, <Thread(tpool_thread_18, started daemon 125443125081792)>, <Thread(tpool_thread_19, started daemon 125443116672704)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:37:00 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:37:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Flow 'volume_create_manager' (22bbb911-0fd1-47d8-8534-87e25beebd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1349e26c-4aa3-4db3-9faa-cca237e0bf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:01 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1349e26c-4aa3-4db3-9faa-cca237e0bf75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-941241666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa3dea5-b91e-4d76-80be-be34c997f011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5bf67c5563b45a893c4cf9b3af9d864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:01Z,use_quota=True,user_id='e051b2b36dbe4eaa85cca09289ca443a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:01 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b22d4cdf-7218-450e-8ad6-cb7301c14804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:01 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b22d4cdf-7218-450e-8ad6-cb7301c14804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:01 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8794b5-9789-4632-b55e-dee5e12372ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:01 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8794b5-9789-4632-b55e-dee5e12372ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aa3dea5-b91e-4d76-80be-be34c997f011', 'volume_name': 'volume-7aa3dea5-b91e-4d76-80be-be34c997f011', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:01 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7bb1f42-d6bf-48bd-ae05-bf77fc2b52a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:01 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7bb1f42-d6bf-48bd-ae05-bf77fc2b52a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:01 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7bcf825-ed00-433f-bc91-ee5f8b77e319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:01 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Volume 7aa3dea5-b91e-4d76-80be-be34c997f011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aa3dea5-b91e-4d76-80be-be34c997f011', 'volume_size': 1}
Nov 07 02:37:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:01 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-941241666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa3dea5-b91e-4d76-80be-be34c997f011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5bf67c5563b45a893c4cf9b3af9d864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:01Z,use_quota=True,user_id='e051b2b36dbe4eaa85cca09289ca443a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:37:01 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Creating volume 7aa3dea5-b91e-4d76-80be-be34c997f011 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:37:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:01 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:01 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:01 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:37:01 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:37:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:01 devstack sudo[95769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011 1073741824
Nov 07 02:37:01 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:01 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011 1073741824" returned: 0 in 0.850s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:02 devstack sudo[95775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011
Nov 07 02:37:02 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:02 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011" returned: 0 in 0.408s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:02 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:37:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:02 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7bcf825-ed00-433f-bc91-ee5f8b77e319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aa3dea5-b91e-4d76-80be-be34c997f011', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:02 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f57576-007a-4fb5-b6bb-78cf34ed0da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:02 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Volume volume-7aa3dea5-b91e-4d76-80be-be34c997f011 (7aa3dea5-b91e-4d76-80be-be34c997f011): created successfully
Nov 07 02:37:02 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f57576-007a-4fb5-b6bb-78cf34ed0da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:02 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Flow 'volume_create_manager' (22bbb911-0fd1-47d8-8534-87e25beebd5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:02 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-3df16f6c-e2f1-4161-a966-a1886812e067 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Created volume successfully.
Nov 07 02:37:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-02ecf0bd-ceb3-4094-b228-0c24fa63421a tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-02ecf0bd-ceb3-4094-b228-0c24fa63421a tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-02ecf0bd-ceb3-4094-b228-0c24fa63421a tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Creating offline snapshot 01bef42f-8f36-4aed-8ef2-812dea89fc0c of volume 7aa3dea5-b91e-4d76-80be-be34c997f011 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:37:03 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e6d6e6-b12b-413c-9c89-9ed4b507641b]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-02ecf0bd-ceb3-4094-b228-0c24fa63421a tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:03 devstack sudo[95780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011
Nov 07 02:37:03 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:04 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-02ecf0bd-ceb3-4094-b228-0c24fa63421a tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011" returned: 0 in 0.602s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-02ecf0bd-ceb3-4094-b228-0c24fa63421a tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.01bef42f-8f36-4aed-8ef2-812dea89fc0c 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:04 devstack sudo[95787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.01bef42f-8f36-4aed-8ef2-812dea89fc0c 1G
Nov 07 02:37:04 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:05 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-02ecf0bd-ceb3-4094-b228-0c24fa63421a tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.01bef42f-8f36-4aed-8ef2-812dea89fc0c 1G" returned: 0 in 0.750s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-02ecf0bd-ceb3-4094-b228-0c24fa63421a tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aa3dea5-b91e-4d76-80be-be34c997f011 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.01bef42f-8f36-4aed-8ef2-812dea89fc0c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:05 devstack sudo[95793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aa3dea5-b91e-4d76-80be-be34c997f011 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.01bef42f-8f36-4aed-8ef2-812dea89fc0c
Nov 07 02:37:05 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:05 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-02ecf0bd-ceb3-4094-b228-0c24fa63421a tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aa3dea5-b91e-4d76-80be-be34c997f011 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.01bef42f-8f36-4aed-8ef2-812dea89fc0c" returned: 0 in 0.395s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:05 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-02ecf0bd-ceb3-4094-b228-0c24fa63421a tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.01bef42f-8f36-4aed-8ef2-812dea89fc0c is being set with open permissions: ugo+rw
Nov 07 02:37:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-02ecf0bd-ceb3-4094-b228-0c24fa63421a tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.01bef42f-8f36-4aed-8ef2-812dea89fc0c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:05 devstack sudo[95799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.01bef42f-8f36-4aed-8ef2-812dea89fc0c
Nov 07 02:37:05 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:05 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-02ecf0bd-ceb3-4094-b228-0c24fa63421a tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.01bef42f-8f36-4aed-8ef2-812dea89fc0c" returned: 0 in 0.332s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-02ecf0bd-ceb3-4094-b228-0c24fa63421a tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:05 devstack sudo[95802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.info
Nov 07 02:37:05 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:06 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-02ecf0bd-ceb3-4094-b228-0c24fa63421a tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.info" returned: 0 in 0.353s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:06 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-02ecf0bd-ceb3-4094-b228-0c24fa63421a tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.info is being set with open permissions: ugo+rw
Nov 07 02:37:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-02ecf0bd-ceb3-4094-b228-0c24fa63421a tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:06 devstack sudo[95805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.info
Nov 07 02:37:06 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:06 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-02ecf0bd-ceb3-4094-b228-0c24fa63421a tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.info" returned: 0 in 0.287s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-02ecf0bd-ceb3-4094-b228-0c24fa63421a tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.886s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:06 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-02ecf0bd-ceb3-4094-b228-0c24fa63421a tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Create snapshot completed successfully
Nov 07 02:37:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-541ebfbf-9d1c-4038-85d7-dc028bcafe95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Acquiring lock "cinder-01bef42f-8f36-4aed-8ef2-812dea89fc0c-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-541ebfbf-9d1c-4038-85d7-dc028bcafe95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Lock "cinder-01bef42f-8f36-4aed-8ef2-812dea89fc0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-541ebfbf-9d1c-4038-85d7-dc028bcafe95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Acquiring lock "cinder-quobyte-7aa3dea5-b91e-4d76-80be-be34c997f011" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-541ebfbf-9d1c-4038-85d7-dc028bcafe95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Lock "cinder-quobyte-7aa3dea5-b91e-4d76-80be-be34c997f011" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-541ebfbf-9d1c-4038-85d7-dc028bcafe95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Acquiring lock "cinder-quobyte-01bef42f-8f36-4aed-8ef2-812dea89fc0c" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-541ebfbf-9d1c-4038-85d7-dc028bcafe95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Lock "cinder-quobyte-01bef42f-8f36-4aed-8ef2-812dea89fc0c" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:07 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-541ebfbf-9d1c-4038-85d7-dc028bcafe95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Deleting offline snapshot 01bef42f-8f36-4aed-8ef2-812dea89fc0c of volume 7aa3dea5-b91e-4d76-80be-be34c997f011 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:37:07 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-541ebfbf-9d1c-4038-85d7-dc028bcafe95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] snapshot_file for this snap is: volume-7aa3dea5-b91e-4d76-80be-be34c997f011.01bef42f-8f36-4aed-8ef2-812dea89fc0c {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:37:07 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c52f096-7569-4869-8eb1-ab4a7733c4a0]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-541ebfbf-9d1c-4038-85d7-dc028bcafe95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.01bef42f-8f36-4aed-8ef2-812dea89fc0c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:07 devstack sudo[95809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.01bef42f-8f36-4aed-8ef2-812dea89fc0c
Nov 07 02:37:07 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:08 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-541ebfbf-9d1c-4038-85d7-dc028bcafe95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.01bef42f-8f36-4aed-8ef2-812dea89fc0c" returned: 0 in 0.483s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-541ebfbf-9d1c-4038-85d7-dc028bcafe95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7aa3dea5-b91e-4d76-80be-be34c997f011(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:37:08 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f42ea12-74ca-44e7-b5c6-a31e4eaad85d]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-541ebfbf-9d1c-4038-85d7-dc028bcafe95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:08 devstack sudo[95815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011
Nov 07 02:37:08 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:08 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:37:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Flow 'volume_create_manager' (65180789-9111-4a8b-a0ca-17977e6caaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa2da822-bd48-405d-a862-eb844be2f422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa2da822-bd48-405d-a862-eb844be2f422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1797693659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9152f47-5541-40e8-b897-44586fb582a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164584085095414fa6d8b60bdd56f3a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:08Z,use_quota=True,user_id='179f9bfc03c3496ea93ff4fd1394bec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bdd4b66-c34e-43b6-81e5-8c1c5235d542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bdd4b66-c34e-43b6-81e5-8c1c5235d542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92e74c4-cf12-4d80-84de-95e86bc912cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:08 devstack cinder-volume[87054]: DEBUG cinder.image.glance [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Creating Keystone auth plugin from conf {{(pid=87054) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 07 02:37:08 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-541ebfbf-9d1c-4038-85d7-dc028bcafe95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011" returned: 0 in 0.530s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-541ebfbf-9d1c-4038-85d7-dc028bcafe95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.01bef42f-8f36-4aed-8ef2-812dea89fc0c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:08 devstack sudo[95823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.01bef42f-8f36-4aed-8ef2-812dea89fc0c
Nov 07 02:37:08 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92e74c4-cf12-4d80-84de-95e86bc912cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a9152f47-5541-40e8-b897-44586fb582a4', 'volume_name': 'volume-a9152f47-5541-40e8-b897-44586fb582a4', 'volume_size': 1, 'image_id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567ec8d3497e4e06904abb9c1c036004', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 25, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72170a0f72c0>}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b0b136-02e8-4d90-91a3-a62407f642de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b0b136-02e8-4d90-91a3-a62407f642de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca4299d-5883-41c9-87bf-b6c74860c28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:08 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Volume a9152f47-5541-40e8-b897-44586fb582a4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a9152f47-5541-40e8-b897-44586fb582a4', 'volume_size': 1, 'image_id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567ec8d3497e4e06904abb9c1c036004', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 25, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72170a0f72c0>}
Nov 07 02:37:08 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Trying to clone a9152f47-5541-40e8-b897-44586fb582a4 from image b7a104a5-0b13-4f47-bea7-fab65f1346d5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}]). {{(pid=87054) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 07 02:37:09 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-541ebfbf-9d1c-4038-85d7-dc028bcafe95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.01bef42f-8f36-4aed-8ef2-812dea89fc0c" returned: 0 in 0.468s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-541ebfbf-9d1c-4038-85d7-dc028bcafe95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.01bef42f-8f36-4aed-8ef2-812dea89fc0c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:09 devstack sudo[95828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.01bef42f-8f36-4aed-8ef2-812dea89fc0c
Nov 07 02:37:09 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:09 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-541ebfbf-9d1c-4038-85d7-dc028bcafe95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011.01bef42f-8f36-4aed-8ef2-812dea89fc0c" returned: 0 in 0.386s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:09 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-541ebfbf-9d1c-4038-85d7-dc028bcafe95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Lock "cinder-quobyte-01bef42f-8f36-4aed-8ef2-812dea89fc0c" released by "_delete_snapshot" :: held 2.106s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:09 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-541ebfbf-9d1c-4038-85d7-dc028bcafe95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Lock "cinder-quobyte-7aa3dea5-b91e-4d76-80be-be34c997f011" released by "delete_snapshot" :: held 2.164s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:09 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_xhrs86usdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 07 02:37:09 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Image download 20.69 MB at 20.69 MB/s
Nov 07 02:37:09 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[116c5313-7f8f-4016-ad8c-e551b4363f53]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_xhrs86usdevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:09 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-541ebfbf-9d1c-4038-85d7-dc028bcafe95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Created reservations ['690ab8d7-4f35-4979-a3ad-a322727806fb', '03c48185-2d26-473e-84b8-e2d81cedaf34', '7bd0e0ae-dd20-4670-8e6c-fabceac3d9e5', '1a5eb1f1-d203-4bca-8ea0-82bde44aebf6'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:37:10 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-541ebfbf-9d1c-4038-85d7-dc028bcafe95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Delete snapshot completed successfully.
Nov 07 02:37:10 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-541ebfbf-9d1c-4038-85d7-dc028bcafe95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Lock "cinder-01bef42f-8f36-4aed-8ef2-812dea89fc0c-delete_snapshot" released by "delete_snapshot" :: held 2.581s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:10 devstack sudo[95833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_xhrs86usdevstack@QuobyteHD
Nov 07 02:37:10 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:10 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_xhrs86usdevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:10 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Temporary image b7a104a5-0b13-4f47-bea7-fab65f1346d5 is fetched for user 179f9bfc03c3496ea93ff4fd1394bec7. {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 07 02:37:10 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d5db9f-ade1-4e14-bb5d-cae07df04e3a]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_xhrs86usdevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:10 devstack sudo[95839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_xhrs86usdevstack@QuobyteHD
Nov 07 02:37:10 devstack sudo[95839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:10 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5671e2fa-fbd9-44fa-8d82-c5edd6072cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Acquiring lock "cinder-7aa3dea5-b91e-4d76-80be-be34c997f011-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:10 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5671e2fa-fbd9-44fa-8d82-c5edd6072cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Lock "cinder-7aa3dea5-b91e-4d76-80be-be34c997f011-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:11 devstack sudo[95839]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:11 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5671e2fa-fbd9-44fa-8d82-c5edd6072cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Acquiring lock "cinder-quobyte-7aa3dea5-b91e-4d76-80be-be34c997f011" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_xhrs86usdevstack@QuobyteHD" returned: 0 in 0.572s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1797693659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9152f47-5541-40e8-b897-44586fb582a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164584085095414fa6d8b60bdd56f3a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:08Z,use_quota=True,user_id='179f9bfc03c3496ea93ff4fd1394bec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:37:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Creating volume a9152f47-5541-40e8-b897-44586fb582a4 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:37:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:37:11 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:37:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:11 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5671e2fa-fbd9-44fa-8d82-c5edd6072cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Lock "cinder-quobyte-7aa3dea5-b91e-4d76-80be-be34c997f011" acquired by "delete_volume" :: waited 0.099s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:11 devstack sudo[95881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4 1073741824
Nov 07 02:37:11 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:11 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb567d86-e154-4845-a846-83574d162144]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5671e2fa-fbd9-44fa-8d82-c5edd6072cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:11 devstack sudo[95884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011
Nov 07 02:37:11 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:11 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5671e2fa-fbd9-44fa-8d82-c5edd6072cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011" returned: 0 in 0.443s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5671e2fa-fbd9-44fa-8d82-c5edd6072cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:11 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4 1073741824" returned: 0 in 0.636s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:11 devstack sudo[95900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011
Nov 07 02:37:11 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:11 devstack sudo[95902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4
Nov 07 02:37:11 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:11 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5671e2fa-fbd9-44fa-8d82-c5edd6072cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7aa3dea5-b91e-4d76-80be-be34c997f011" returned: 0 in 0.296s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:12 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5671e2fa-fbd9-44fa-8d82-c5edd6072cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Lock "cinder-quobyte-7aa3dea5-b91e-4d76-80be-be34c997f011" released by "delete_volume" :: held 0.889s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:12 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4" returned: 0 in 0.272s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:37:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:12 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Attempting download of b7a104a5-0b13-4f47-bea7-fab65f1346d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}])) to volume a9152f47-5541-40e8-b897-44586fb582a4. {{(pid=87054) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 07 02:37:12 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-5671e2fa-fbd9-44fa-8d82-c5edd6072cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Created reservations ['f1f425ac-d856-4d7c-b6fe-bf383b9c9ee3', '60256045-cd6c-451b-8ea1-ac49153be82d', '331bbf62-50c1-42ad-b197-6ce19ba97081', 'd488e3c0-e4a2-4f53-bdb4-086cb58d3e21'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:37:12 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ccaf42-4ee0-4631-906b-2d966e56e5af]: (4, 'raw') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_31swsqms {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5671e2fa-fbd9-44fa-8d82-c5edd6072cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5671e2fa-fbd9-44fa-8d82-c5edd6072cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5671e2fa-fbd9-44fa-8d82-c5edd6072cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5671e2fa-fbd9-44fa-8d82-c5edd6072cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5671e2fa-fbd9-44fa-8d82-c5edd6072cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5671e2fa-fbd9-44fa-8d82-c5edd6072cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:12 devstack sudo[95907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:37:12 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:12 devstack sudo[95906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_31swsqms
Nov 07 02:37:12 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:12 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5671e2fa-fbd9-44fa-8d82-c5edd6072cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.306s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:12 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-5671e2fa-fbd9-44fa-8d82-c5edd6072cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:37:12 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_31swsqms" returned: 0 in 0.400s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_31swsqms {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:12 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-5671e2fa-fbd9-44fa-8d82-c5edd6072cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Deleted volume successfully.
Nov 07 02:37:12 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5671e2fa-fbd9-44fa-8d82-c5edd6072cfa tempest-VolumeSnapshotQuotasNegativeTestJSON-1983846084 None] Lock "cinder-7aa3dea5-b91e-4d76-80be-be34c997f011-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:12 devstack sudo[95913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_31swsqms
Nov 07 02:37:12 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:12 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_31swsqms" returned: 1 in 0.347s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_31swsqms' failed. Not Retrying. {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:37:12 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[04005dcf-9dab-4630-96b7-fec073df40eb]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_xhrs86usdevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:13 devstack sudo[95918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_xhrs86usdevstack@QuobyteHD
Nov 07 02:37:13 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:13 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_xhrs86usdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:13 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] b7a104a5-0b13-4f47-bea7-fab65f1346d5 was qcow2, converting to qcow2 {{(pid=87054) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 07 02:37:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_xhrs86usdevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:13 devstack sudo[95923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_xhrs86usdevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4
Nov 07 02:37:13 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:16 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_xhrs86usdevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4" returned: 0 in 3.078s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:16 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_xhrs86usdevstack@QuobyteHD, size 112.00 MB, duration 3.08 sec, destination /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4 {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:37:16 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Converted 112.00 MB image at 36.37 MB/s
Nov 07 02:37:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:16 devstack sudo[96010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4 1G
Nov 07 02:37:16 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:16 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4 1G" returned: 0 in 0.463s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:16 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Downloaded image b7a104a5-0b13-4f47-bea7-fab65f1346d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}])) to volume a9152f47-5541-40e8-b897-44586fb582a4 successfully. {{(pid=87054) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 07 02:37:16 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Temporary image b7a104a5-0b13-4f47-bea7-fab65f1346d5 for user 179f9bfc03c3496ea93ff4fd1394bec7 is deleted. {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 07 02:37:16 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Marking volume a9152f47-5541-40e8-b897-44586fb582a4 as bootable. {{(pid=87054) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 07 02:37:16 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Copying metadata from image b7a104a5-0b13-4f47-bea7-fab65f1346d5 to a9152f47-5541-40e8-b897-44586fb582a4. {{(pid=87054) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 07 02:37:16 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Creating volume glance metadata for volume a9152f47-5541-40e8-b897-44586fb582a4 backed by image b7a104a5-0b13-4f47-bea7-fab65f1346d5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87054) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 07 02:37:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca4299d-5883-41c9-87bf-b6c74860c28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9152f47-5541-40e8-b897-44586fb582a4', 'volume_size': 1, 'image_id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567ec8d3497e4e06904abb9c1c036004', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 25, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72170a0f72c0>}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a176799-cfb3-43c2-a1d5-33509a722b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:17 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Volume volume-a9152f47-5541-40e8-b897-44586fb582a4 (a9152f47-5541-40e8-b897-44586fb582a4): created successfully
Nov 07 02:37:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a176799-cfb3-43c2-a1d5-33509a722b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Flow 'volume_create_manager' (65180789-9111-4a8b-a0ca-17977e6caaac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:17 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-300bd2b9-1d7e-4f3b-872a-0c9730a1207a tempest-VolumesExtendTest-1983679099 None] Created volume successfully.
Nov 07 02:37:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-50a7aa21-caa8-42f5-9cd3-65a44d233835 tempest-VolumesExtendTest-1983679099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-50a7aa21-caa8-42f5-9cd3-65a44d233835 tempest-VolumesExtendTest-1983679099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:17 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98d6474-ed1f-4381-983e-7f0be7213409]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-50a7aa21-caa8-42f5-9cd3-65a44d233835 tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:17 devstack sudo[96018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4
Nov 07 02:37:17 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:18 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-50a7aa21-caa8-42f5-9cd3-65a44d233835 tempest-VolumesExtendTest-1983679099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4" returned: 0 in 0.629s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-50a7aa21-caa8-42f5-9cd3-65a44d233835 tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4 2G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-50a7aa21-caa8-42f5-9cd3-65a44d233835 tempest-VolumesExtendTest-1983679099 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4 2G" returned: 0 in 0.168s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-50a7aa21-caa8-42f5-9cd3-65a44d233835 tempest-VolumesExtendTest-1983679099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.846s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:18 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-50a7aa21-caa8-42f5-9cd3-65a44d233835 tempest-VolumesExtendTest-1983679099 None] Extend volume completed successfully.
Nov 07 02:37:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c83adfde-0c58-435a-832f-ca9bbb6436c6 tempest-VolumesExtendTest-1983679099 None] Acquiring lock "cinder-a9152f47-5541-40e8-b897-44586fb582a4-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c83adfde-0c58-435a-832f-ca9bbb6436c6 tempest-VolumesExtendTest-1983679099 None] Lock "cinder-a9152f47-5541-40e8-b897-44586fb582a4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c83adfde-0c58-435a-832f-ca9bbb6436c6 tempest-VolumesExtendTest-1983679099 None] Acquiring lock "cinder-quobyte-a9152f47-5541-40e8-b897-44586fb582a4" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c83adfde-0c58-435a-832f-ca9bbb6436c6 tempest-VolumesExtendTest-1983679099 None] Lock "cinder-quobyte-a9152f47-5541-40e8-b897-44586fb582a4" acquired by "delete_volume" :: waited 0.033s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:19 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c41f79-abc0-4e0a-8b6a-63e110956df4]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c83adfde-0c58-435a-832f-ca9bbb6436c6 tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:20 devstack sudo[96027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4
Nov 07 02:37:20 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:20 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c83adfde-0c58-435a-832f-ca9bbb6436c6 tempest-VolumesExtendTest-1983679099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4" returned: 0 in 0.578s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c83adfde-0c58-435a-832f-ca9bbb6436c6 tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:20 devstack sudo[96033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4
Nov 07 02:37:20 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:20 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c83adfde-0c58-435a-832f-ca9bbb6436c6 tempest-VolumesExtendTest-1983679099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a9152f47-5541-40e8-b897-44586fb582a4" returned: 0 in 0.355s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c83adfde-0c58-435a-832f-ca9bbb6436c6 tempest-VolumesExtendTest-1983679099 None] Lock "cinder-quobyte-a9152f47-5541-40e8-b897-44586fb582a4" released by "delete_volume" :: held 1.040s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:21 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-c83adfde-0c58-435a-832f-ca9bbb6436c6 tempest-VolumesExtendTest-1983679099 None] Created reservations ['06e10832-0924-4897-be93-1d283ff11826', 'b5c0edf8-b232-49c7-b8b8-fc65e1b7bda5', 'af07c87b-5403-4442-b560-5cd1be07d6d8', 'a80fedad-13c2-4309-9038-e7307204210c'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:37:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c83adfde-0c58-435a-832f-ca9bbb6436c6 tempest-VolumesExtendTest-1983679099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c83adfde-0c58-435a-832f-ca9bbb6436c6 tempest-VolumesExtendTest-1983679099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:21 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c83adfde-0c58-435a-832f-ca9bbb6436c6 tempest-VolumesExtendTest-1983679099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:21 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c83adfde-0c58-435a-832f-ca9bbb6436c6 tempest-VolumesExtendTest-1983679099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c83adfde-0c58-435a-832f-ca9bbb6436c6 tempest-VolumesExtendTest-1983679099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c83adfde-0c58-435a-832f-ca9bbb6436c6 tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:21 devstack sudo[96036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:37:21 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:21 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c83adfde-0c58-435a-832f-ca9bbb6436c6 tempest-VolumesExtendTest-1983679099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.360s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:21 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-c83adfde-0c58-435a-832f-ca9bbb6436c6 tempest-VolumesExtendTest-1983679099 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:37:21 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c83adfde-0c58-435a-832f-ca9bbb6436c6 tempest-VolumesExtendTest-1983679099 None] Deleted volume successfully.
Nov 07 02:37:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c83adfde-0c58-435a-832f-ca9bbb6436c6 tempest-VolumesExtendTest-1983679099 None] Lock "cinder-a9152f47-5541-40e8-b897-44586fb582a4-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Flow 'volume_create_manager' (9746a0aa-c27c-42ac-af11-4f5bf23057a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ed0fd4-0eff-479a-b86e-2b62882a0677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ed0fd4-0eff-479a-b86e-2b62882a0677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1142631050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b282d5b-3535-4b85-bed3-89949d2e6019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164584085095414fa6d8b60bdd56f3a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:23Z,use_quota=True,user_id='179f9bfc03c3496ea93ff4fd1394bec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f24b5a-1e91-4384-89a2-f19fab1d2c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f24b5a-1e91-4384-89a2-f19fab1d2c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffded47b-cffe-483f-b157-28b22ac7950c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffded47b-cffe-483f-b157-28b22ac7950c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b282d5b-3535-4b85-bed3-89949d2e6019', 'volume_name': 'volume-8b282d5b-3535-4b85-bed3-89949d2e6019', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005f939d-4cad-4852-85d5-3d4babfcf01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005f939d-4cad-4852-85d5-3d4babfcf01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a22efbe-6df2-4e16-a022-449029bd6e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:22 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Volume 8b282d5b-3535-4b85-bed3-89949d2e6019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b282d5b-3535-4b85-bed3-89949d2e6019', 'volume_size': 1}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1142631050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b282d5b-3535-4b85-bed3-89949d2e6019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164584085095414fa6d8b60bdd56f3a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:23Z,use_quota=True,user_id='179f9bfc03c3496ea93ff4fd1394bec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Creating volume 8b282d5b-3535-4b85-bed3-89949d2e6019 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:37:22 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:22 devstack sudo[96039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019 1073741824
Nov 07 02:37:22 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Flow 'volume_create_manager' (70eca449-1d52-47c0-afb7-4ae802f66d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6369789-653f-4673-b32a-fba33d2fe939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:22 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6369789-653f-4673-b32a-fba33d2fe939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-868015901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa3d16e6-b3ed-42ae-90df-0e78a851cbc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf91f62469c40bea0984f46b6499112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:23Z,use_quota=True,user_id='d0be838ed8fd4c3f93ebc7f44fab1b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea3e6029-8ec3-4ad1-a5ec-fd5fa72df2d4),volume_type_id=ea3e6029-8ec3-4ad1-a5ec-fd5fa72df2d4)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f7c634-5b83-4c1c-b280-843e79f2af0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f7c634-5b83-4c1c-b280-843e79f2af0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce5d5d0-0add-46bc-b1b5-6ca22d8cee68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce5d5d0-0add-46bc-b1b5-6ca22d8cee68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa3d16e6-b3ed-42ae-90df-0e78a851cbc8', 'volume_name': 'volume-aa3d16e6-b3ed-42ae-90df-0e78a851cbc8', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca6b726-14b4-4a5e-b725-e231132ea2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca6b726-14b4-4a5e-b725-e231132ea2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572bfc07-ec40-4c1b-a2f7-a20eae849a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:23 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Volume aa3d16e6-b3ed-42ae-90df-0e78a851cbc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa3d16e6-b3ed-42ae-90df-0e78a851cbc8', 'volume_size': 1}
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:23 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019 1073741824" returned: 0 in 0.471s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:23 devstack sudo[96045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019
Nov 07 02:37:23 devstack sudo[96045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:23 devstack sudo[96045]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019" returned: 0 in 0.258s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.543s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-868015901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa3d16e6-b3ed-42ae-90df-0e78a851cbc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf91f62469c40bea0984f46b6499112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:23Z,use_quota=True,user_id='d0be838ed8fd4c3f93ebc7f44fab1b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea3e6029-8ec3-4ad1-a5ec-fd5fa72df2d4),volume_type_id=ea3e6029-8ec3-4ad1-a5ec-fd5fa72df2d4)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Creating volume aa3d16e6-b3ed-42ae-90df-0e78a851cbc8 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:37:23 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa3d16e6-b3ed-42ae-90df-0e78a851cbc8 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:23 devstack sudo[96048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa3d16e6-b3ed-42ae-90df-0e78a851cbc8 1073741824
Nov 07 02:37:23 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a22efbe-6df2-4e16-a022-449029bd6e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b282d5b-3535-4b85-bed3-89949d2e6019', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (168baf0a-7889-4b06-a6e5-139729a46c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:23 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Volume volume-8b282d5b-3535-4b85-bed3-89949d2e6019 (8b282d5b-3535-4b85-bed3-89949d2e6019): created successfully
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (168baf0a-7889-4b06-a6e5-139729a46c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Flow 'volume_create_manager' (9746a0aa-c27c-42ac-af11-4f5bf23057a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:23 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-cd30f525-b7cb-41c9-8357-7dab7819301b tempest-VolumesExtendTest-1983679099 None] Created volume successfully.
Nov 07 02:37:24 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa3d16e6-b3ed-42ae-90df-0e78a851cbc8 1073741824" returned: 0 in 0.488s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa3d16e6-b3ed-42ae-90df-0e78a851cbc8 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:24 devstack sudo[96060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa3d16e6-b3ed-42ae-90df-0e78a851cbc8
Nov 07 02:37:24 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:24 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa3d16e6-b3ed-42ae-90df-0e78a851cbc8" returned: 0 in 0.283s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572bfc07-ec40-4c1b-a2f7-a20eae849a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa3d16e6-b3ed-42ae-90df-0e78a851cbc8', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0db170f-b8dc-4e75-89c9-85e670bb8607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:24 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Volume volume-aa3d16e6-b3ed-42ae-90df-0e78a851cbc8 (aa3d16e6-b3ed-42ae-90df-0e78a851cbc8): created successfully
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0db170f-b8dc-4e75-89c9-85e670bb8607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Flow 'volume_create_manager' (70eca449-1d52-47c0-afb7-4ae802f66d50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:24 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ce14f4b8-e25c-4529-8a17-aa78e8ac4a36 tempest-VolumeTypesAccessTest-1517390641 None] Created volume successfully.
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Flow 'volume_create_manager' (1aef01bd-d8b4-4c89-a3b2-676bf3046a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ee5591-a003-4858-837b-d10c83f27364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ee5591-a003-4858-837b-d10c83f27364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1608750446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7be5c17daf3459a9fd7e8c35dab76a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:25Z,use_quota=True,user_id='145be3ecf2874d55916d564de13c32e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba7b401-8a99-4790-97e0-b935ae412f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba7b401-8a99-4790-97e0-b935ae412f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd85f00-906a-4551-882e-7e055bf01ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd85f00-906a-4551-882e-7e055bf01ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3', 'volume_name': 'volume-041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d9773d-d33a-44e0-8a7c-dc5be04b74fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d9773d-d33a-44e0-8a7c-dc5be04b74fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f899c9-d7f4-449c-a5dd-8a32d8365a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:24 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Volume 041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3', 'volume_size': 1}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1608750446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7be5c17daf3459a9fd7e8c35dab76a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:25Z,use_quota=True,user_id='145be3ecf2874d55916d564de13c32e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Creating volume 041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:37:24 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:37:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:25 devstack sudo[96063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3 1073741824
Nov 07 02:37:25 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ff88ec34-5aa6-404e-a4e6-04504f4352c0 tempest-VolumesExtendTest-1983679099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-68bf1535-7841-4600-b9f8-e4aa1016d38a tempest-VolumeTypesAccessTest-1517390641 None] Acquiring lock "cinder-aa3d16e6-b3ed-42ae-90df-0e78a851cbc8-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-68bf1535-7841-4600-b9f8-e4aa1016d38a tempest-VolumeTypesAccessTest-1517390641 None] Lock "cinder-aa3d16e6-b3ed-42ae-90df-0e78a851cbc8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-68bf1535-7841-4600-b9f8-e4aa1016d38a tempest-VolumeTypesAccessTest-1517390641 None] Acquiring lock "cinder-quobyte-aa3d16e6-b3ed-42ae-90df-0e78a851cbc8" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-68bf1535-7841-4600-b9f8-e4aa1016d38a tempest-VolumeTypesAccessTest-1517390641 None] Lock "cinder-quobyte-aa3d16e6-b3ed-42ae-90df-0e78a851cbc8" acquired by "delete_volume" :: waited 0.018s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2a6aff-1dd6-4d24-b863-59fa8e8e29d6]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-68bf1535-7841-4600-b9f8-e4aa1016d38a tempest-VolumeTypesAccessTest-1517390641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa3d16e6-b3ed-42ae-90df-0e78a851cbc8 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:25 devstack sudo[96068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa3d16e6-b3ed-42ae-90df-0e78a851cbc8
Nov 07 02:37:25 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:25 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3 1073741824" returned: 0 in 0.500s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:UPDATE=65,cinder:SELECT=61,cinder:DELETE=3,cinder:INSERT=25 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:25 devstack sudo[96071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3
Nov 07 02:37:25 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:25 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-68bf1535-7841-4600-b9f8-e4aa1016d38a tempest-VolumeTypesAccessTest-1517390641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa3d16e6-b3ed-42ae-90df-0e78a851cbc8" returned: 0 in 0.377s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-68bf1535-7841-4600-b9f8-e4aa1016d38a tempest-VolumeTypesAccessTest-1517390641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa3d16e6-b3ed-42ae-90df-0e78a851cbc8 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:25 devstack sudo[96076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa3d16e6-b3ed-42ae-90df-0e78a851cbc8
Nov 07 02:37:25 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:25 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3" returned: 0 in 0.284s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ff88ec34-5aa6-404e-a4e6-04504f4352c0 tempest-VolumesExtendTest-1983679099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.736s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=67,cinder:UPDATE=67,cinder:INSERT=16,cinder:DELETE=8 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f899c9-d7f4-449c-a5dd-8a32d8365a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18fa184-db4a-459f-9cc5-d166e5de472e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ff88ec34-5aa6-404e-a4e6-04504f4352c0 tempest-VolumesExtendTest-1983679099 None] Creating offline snapshot 0b791b0b-dc04-439b-9774-400ff4d99190 of volume 8b282d5b-3535-4b85-bed3-89949d2e6019 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:37:25 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Volume volume-041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3 (041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3): created successfully
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18fa184-db4a-459f-9cc5-d166e5de472e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Flow 'volume_create_manager' (1aef01bd-d8b4-4c89-a3b2-676bf3046a3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bebc23a-6841-46e3-885d-6895006852a3]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff88ec34-5aa6-404e-a4e6-04504f4352c0 tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:25 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-cbcc0ffa-b77e-4434-9c4e-7f7482c38e6f tempest-AttachVolumeTestJSON-63735962 None] Created volume successfully.
Nov 07 02:37:25 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-68bf1535-7841-4600-b9f8-e4aa1016d38a tempest-VolumeTypesAccessTest-1517390641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa3d16e6-b3ed-42ae-90df-0e78a851cbc8" returned: 0 in 0.290s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-68bf1535-7841-4600-b9f8-e4aa1016d38a tempest-VolumeTypesAccessTest-1517390641 None] Lock "cinder-quobyte-aa3d16e6-b3ed-42ae-90df-0e78a851cbc8" released by "delete_volume" :: held 0.718s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:26 devstack cinder-volume[87054]: WARNING cinder.quota [None req-68bf1535-7841-4600-b9f8-e4aa1016d38a tempest-VolumeTypesAccessTest-1517390641 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-594020607 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-594020607, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:37:26 devstack cinder-volume[87054]: WARNING cinder.quota [None req-68bf1535-7841-4600-b9f8-e4aa1016d38a tempest-VolumeTypesAccessTest-1517390641 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-594020607 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-594020607, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:37:26 devstack sudo[96079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019
Nov 07 02:37:26 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:26 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-68bf1535-7841-4600-b9f8-e4aa1016d38a tempest-VolumeTypesAccessTest-1517390641 None] Created reservations ['94937ee8-0312-4f73-b367-308a43cae7ea', '2a79da0c-d992-42b0-8e84-85ba134f8474', '5142cc16-eacb-4fec-a825-d803cc436be1', '26b61cc8-505a-4a69-961f-c39ec39bc723'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:37:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-68bf1535-7841-4600-b9f8-e4aa1016d38a tempest-VolumeTypesAccessTest-1517390641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-68bf1535-7841-4600-b9f8-e4aa1016d38a tempest-VolumeTypesAccessTest-1517390641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-68bf1535-7841-4600-b9f8-e4aa1016d38a tempest-VolumeTypesAccessTest-1517390641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-68bf1535-7841-4600-b9f8-e4aa1016d38a tempest-VolumeTypesAccessTest-1517390641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-68bf1535-7841-4600-b9f8-e4aa1016d38a tempest-VolumeTypesAccessTest-1517390641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-68bf1535-7841-4600-b9f8-e4aa1016d38a tempest-VolumeTypesAccessTest-1517390641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:26 devstack sudo[96082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:37:26 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:26 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff88ec34-5aa6-404e-a4e6-04504f4352c0 tempest-VolumesExtendTest-1983679099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019" returned: 0 in 0.568s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff88ec34-5aa6-404e-a4e6-04504f4352c0 tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.0b791b0b-dc04-439b-9774-400ff4d99190 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:26 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-68bf1535-7841-4600-b9f8-e4aa1016d38a tempest-VolumeTypesAccessTest-1517390641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.333s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:26 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-68bf1535-7841-4600-b9f8-e4aa1016d38a tempest-VolumeTypesAccessTest-1517390641 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:37:26 devstack sudo[96088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.0b791b0b-dc04-439b-9774-400ff4d99190 1G
Nov 07 02:37:26 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:26 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-68bf1535-7841-4600-b9f8-e4aa1016d38a tempest-VolumeTypesAccessTest-1517390641 None] Deleted volume successfully.
Nov 07 02:37:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-68bf1535-7841-4600-b9f8-e4aa1016d38a tempest-VolumeTypesAccessTest-1517390641 None] Lock "cinder-aa3d16e6-b3ed-42ae-90df-0e78a851cbc8-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:26 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff88ec34-5aa6-404e-a4e6-04504f4352c0 tempest-VolumesExtendTest-1983679099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.0b791b0b-dc04-439b-9774-400ff4d99190 1G" returned: 0 in 0.535s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff88ec34-5aa6-404e-a4e6-04504f4352c0 tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b282d5b-3535-4b85-bed3-89949d2e6019 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.0b791b0b-dc04-439b-9774-400ff4d99190 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:27 devstack sudo[96093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b282d5b-3535-4b85-bed3-89949d2e6019 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.0b791b0b-dc04-439b-9774-400ff4d99190
Nov 07 02:37:27 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:27 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff88ec34-5aa6-404e-a4e6-04504f4352c0 tempest-VolumesExtendTest-1983679099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b282d5b-3535-4b85-bed3-89949d2e6019 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.0b791b0b-dc04-439b-9774-400ff4d99190" returned: 0 in 0.412s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:27 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-ff88ec34-5aa6-404e-a4e6-04504f4352c0 tempest-VolumesExtendTest-1983679099 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.0b791b0b-dc04-439b-9774-400ff4d99190 is being set with open permissions: ugo+rw
Nov 07 02:37:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff88ec34-5aa6-404e-a4e6-04504f4352c0 tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.0b791b0b-dc04-439b-9774-400ff4d99190 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:27 devstack sudo[96103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.0b791b0b-dc04-439b-9774-400ff4d99190
Nov 07 02:37:27 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:27 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff88ec34-5aa6-404e-a4e6-04504f4352c0 tempest-VolumesExtendTest-1983679099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.0b791b0b-dc04-439b-9774-400ff4d99190" returned: 0 in 0.378s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff88ec34-5aa6-404e-a4e6-04504f4352c0 tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:27 devstack sudo[96114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.info
Nov 07 02:37:27 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-a7f60087-7fba-48bf-8f61-fdce56edf0d7 req-f4e67377-305a-41f6-b050-23e9e7105a46 tempest-AttachVolumeTestJSON-63735962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:28 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff88ec34-5aa6-404e-a4e6-04504f4352c0 tempest-VolumesExtendTest-1983679099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.info" returned: 0 in 0.345s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:28 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-ff88ec34-5aa6-404e-a4e6-04504f4352c0 tempest-VolumesExtendTest-1983679099 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.info is being set with open permissions: ugo+rw
Nov 07 02:37:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff88ec34-5aa6-404e-a4e6-04504f4352c0 tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:28 devstack sudo[96154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.info
Nov 07 02:37:28 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:28 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff88ec34-5aa6-404e-a4e6-04504f4352c0 tempest-VolumesExtendTest-1983679099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.info" returned: 0 in 0.298s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ff88ec34-5aa6-404e-a4e6-04504f4352c0 tempest-VolumesExtendTest-1983679099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.692s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-a7f60087-7fba-48bf-8f61-fdce56edf0d7 req-f4e67377-305a-41f6-b050-23e9e7105a46 tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.494s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-a7f60087-7fba-48bf-8f61-fdce56edf0d7 req-f4e67377-305a-41f6-b050-23e9e7105a46 tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:28 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ff88ec34-5aa6-404e-a4e6-04504f4352c0 tempest-VolumesExtendTest-1983679099 None] Create snapshot completed successfully
Nov 07 02:37:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-a7f60087-7fba-48bf-8f61-fdce56edf0d7 req-f4e67377-305a-41f6-b050-23e9e7105a46 tempest-AttachVolumeTestJSON-63735962 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c', 'name': 'volume-041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '764dc2b0-d4d0-4d0b-881e-007e61a6cbb6', 'enforce_multipath': True} {{(pid=87054) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:37:28 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-a7f60087-7fba-48bf-8f61-fdce56edf0d7 req-f4e67377-305a-41f6-b050-23e9e7105a46 tempest-AttachVolumeTestJSON-63735962 None] attachment_update completed successfully.
Nov 07 02:37:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-aabb82cb-4104-44f3-9694-0cf79541305d tempest-VolumesExtendTest-1983679099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-aabb82cb-4104-44f3-9694-0cf79541305d tempest-VolumesExtendTest-1983679099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:29 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[15057b83-b805-455f-879c-c811304a75d0]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aabb82cb-4104-44f3-9694-0cf79541305d tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:29 devstack sudo[96572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019
Nov 07 02:37:29 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:29 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aabb82cb-4104-44f3-9694-0cf79541305d tempest-VolumesExtendTest-1983679099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019" returned: 0 in 0.458s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aabb82cb-4104-44f3-9694-0cf79541305d tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.0b791b0b-dc04-439b-9774-400ff4d99190 2G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aabb82cb-4104-44f3-9694-0cf79541305d tempest-VolumesExtendTest-1983679099 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.0b791b0b-dc04-439b-9774-400ff4d99190 2G" returned: 0 in 0.147s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-aabb82cb-4104-44f3-9694-0cf79541305d tempest-VolumesExtendTest-1983679099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.665s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:30 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-aabb82cb-4104-44f3-9694-0cf79541305d tempest-VolumesExtendTest-1983679099 None] Extend volume completed successfully.
Nov 07 02:37:30 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5dd521cd-e991-47ad-a5c2-f6ed2cdacdb5 tempest-VolumesExtendTest-1983679099 None] Acquiring lock "cinder-0b791b0b-dc04-439b-9774-400ff4d99190-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:30 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5dd521cd-e991-47ad-a5c2-f6ed2cdacdb5 tempest-VolumesExtendTest-1983679099 None] Lock "cinder-0b791b0b-dc04-439b-9774-400ff4d99190-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:30 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5dd521cd-e991-47ad-a5c2-f6ed2cdacdb5 tempest-VolumesExtendTest-1983679099 None] Acquiring lock "cinder-quobyte-8b282d5b-3535-4b85-bed3-89949d2e6019" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:30 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5dd521cd-e991-47ad-a5c2-f6ed2cdacdb5 tempest-VolumesExtendTest-1983679099 None] Lock "cinder-quobyte-8b282d5b-3535-4b85-bed3-89949d2e6019" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:30 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5dd521cd-e991-47ad-a5c2-f6ed2cdacdb5 tempest-VolumesExtendTest-1983679099 None] Acquiring lock "cinder-quobyte-0b791b0b-dc04-439b-9774-400ff4d99190" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:30 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5dd521cd-e991-47ad-a5c2-f6ed2cdacdb5 tempest-VolumesExtendTest-1983679099 None] Lock "cinder-quobyte-0b791b0b-dc04-439b-9774-400ff4d99190" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-5dd521cd-e991-47ad-a5c2-f6ed2cdacdb5 tempest-VolumesExtendTest-1983679099 None] Deleting offline snapshot 0b791b0b-dc04-439b-9774-400ff4d99190 of volume 8b282d5b-3535-4b85-bed3-89949d2e6019 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:37:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-5dd521cd-e991-47ad-a5c2-f6ed2cdacdb5 tempest-VolumesExtendTest-1983679099 None] snapshot_file for this snap is: volume-8b282d5b-3535-4b85-bed3-89949d2e6019.0b791b0b-dc04-439b-9774-400ff4d99190 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:37:30 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e6bee0-bf46-4821-bd73-575974cef42c]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5dd521cd-e991-47ad-a5c2-f6ed2cdacdb5 tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.0b791b0b-dc04-439b-9774-400ff4d99190 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:31 devstack sudo[96587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.0b791b0b-dc04-439b-9774-400ff4d99190
Nov 07 02:37:31 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:31 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5dd521cd-e991-47ad-a5c2-f6ed2cdacdb5 tempest-VolumesExtendTest-1983679099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.0b791b0b-dc04-439b-9774-400ff4d99190" returned: 0 in 0.397s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:31 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-5dd521cd-e991-47ad-a5c2-f6ed2cdacdb5 tempest-VolumesExtendTest-1983679099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b282d5b-3535-4b85-bed3-89949d2e6019(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:37:31 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80884cc-bfca-4643-9560-9f729aae1053]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5dd521cd-e991-47ad-a5c2-f6ed2cdacdb5 tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:31 devstack sudo[96592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019
Nov 07 02:37:31 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:31 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5dd521cd-e991-47ad-a5c2-f6ed2cdacdb5 tempest-VolumesExtendTest-1983679099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019" returned: 0 in 0.400s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5dd521cd-e991-47ad-a5c2-f6ed2cdacdb5 tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.0b791b0b-dc04-439b-9774-400ff4d99190 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:31 devstack sudo[96597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.0b791b0b-dc04-439b-9774-400ff4d99190
Nov 07 02:37:31 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:32 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5dd521cd-e991-47ad-a5c2-f6ed2cdacdb5 tempest-VolumesExtendTest-1983679099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.0b791b0b-dc04-439b-9774-400ff4d99190" returned: 0 in 0.486s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5dd521cd-e991-47ad-a5c2-f6ed2cdacdb5 tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.0b791b0b-dc04-439b-9774-400ff4d99190 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:32 devstack sudo[96603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.0b791b0b-dc04-439b-9774-400ff4d99190
Nov 07 02:37:32 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:32 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5dd521cd-e991-47ad-a5c2-f6ed2cdacdb5 tempest-VolumesExtendTest-1983679099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019.0b791b0b-dc04-439b-9774-400ff4d99190" returned: 0 in 0.282s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5dd521cd-e991-47ad-a5c2-f6ed2cdacdb5 tempest-VolumesExtendTest-1983679099 None] Lock "cinder-quobyte-0b791b0b-dc04-439b-9774-400ff4d99190" released by "_delete_snapshot" :: held 1.700s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5dd521cd-e991-47ad-a5c2-f6ed2cdacdb5 tempest-VolumesExtendTest-1983679099 None] Lock "cinder-quobyte-8b282d5b-3535-4b85-bed3-89949d2e6019" released by "delete_snapshot" :: held 1.738s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:32 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-5dd521cd-e991-47ad-a5c2-f6ed2cdacdb5 tempest-VolumesExtendTest-1983679099 None] Created reservations ['f91e6111-3a27-4672-849a-c7f03d47a133', 'e87b634b-8488-47af-b2ac-3cd6c9a23658', '500dd2cc-2e7a-421e-99af-34bc7bee732d', 'b9cecc74-536a-43e7-884b-53c7ecd5ea0c'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:37:32 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-5dd521cd-e991-47ad-a5c2-f6ed2cdacdb5 tempest-VolumesExtendTest-1983679099 None] Delete snapshot completed successfully.
Nov 07 02:37:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5dd521cd-e991-47ad-a5c2-f6ed2cdacdb5 tempest-VolumesExtendTest-1983679099 None] Lock "cinder-0b791b0b-dc04-439b-9774-400ff4d99190-delete_snapshot" released by "delete_snapshot" :: held 1.912s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7c8f5b82-aaa4-4774-a0fa-5c46b26b7388 tempest-VolumesExtendTest-1983679099 None] Acquiring lock "cinder-8b282d5b-3535-4b85-bed3-89949d2e6019-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7c8f5b82-aaa4-4774-a0fa-5c46b26b7388 tempest-VolumesExtendTest-1983679099 None] Lock "cinder-8b282d5b-3535-4b85-bed3-89949d2e6019-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7c8f5b82-aaa4-4774-a0fa-5c46b26b7388 tempest-VolumesExtendTest-1983679099 None] Acquiring lock "cinder-quobyte-8b282d5b-3535-4b85-bed3-89949d2e6019" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7c8f5b82-aaa4-4774-a0fa-5c46b26b7388 tempest-VolumesExtendTest-1983679099 None] Lock "cinder-quobyte-8b282d5b-3535-4b85-bed3-89949d2e6019" acquired by "delete_volume" :: waited 0.037s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:33 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0905c3-f177-404a-9dea-3a3b0e7f589a]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7c8f5b82-aaa4-4774-a0fa-5c46b26b7388 tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:33 devstack sudo[96746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019
Nov 07 02:37:33 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:33 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7c8f5b82-aaa4-4774-a0fa-5c46b26b7388 tempest-VolumesExtendTest-1983679099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019" returned: 0 in 0.564s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7c8f5b82-aaa4-4774-a0fa-5c46b26b7388 tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:33 devstack sudo[96761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019
Nov 07 02:37:33 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:34 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7c8f5b82-aaa4-4774-a0fa-5c46b26b7388 tempest-VolumesExtendTest-1983679099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b282d5b-3535-4b85-bed3-89949d2e6019" returned: 0 in 0.264s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7c8f5b82-aaa4-4774-a0fa-5c46b26b7388 tempest-VolumesExtendTest-1983679099 None] Lock "cinder-quobyte-8b282d5b-3535-4b85-bed3-89949d2e6019" released by "delete_volume" :: held 1.005s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:34 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-7c8f5b82-aaa4-4774-a0fa-5c46b26b7388 tempest-VolumesExtendTest-1983679099 None] Created reservations ['bba8d38c-10fa-409d-80e8-1fc422036b5f', 'ba8139e9-286d-4a24-8005-d194c992e429', 'd03f102f-3e3d-4d70-8cc0-82f29a2c9036', 'e3f1c52b-a461-44ba-9ffe-9bd7b8ab054a'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:37:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7c8f5b82-aaa4-4774-a0fa-5c46b26b7388 tempest-VolumesExtendTest-1983679099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7c8f5b82-aaa4-4774-a0fa-5c46b26b7388 tempest-VolumesExtendTest-1983679099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7c8f5b82-aaa4-4774-a0fa-5c46b26b7388 tempest-VolumesExtendTest-1983679099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7c8f5b82-aaa4-4774-a0fa-5c46b26b7388 tempest-VolumesExtendTest-1983679099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7c8f5b82-aaa4-4774-a0fa-5c46b26b7388 tempest-VolumesExtendTest-1983679099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7c8f5b82-aaa4-4774-a0fa-5c46b26b7388 tempest-VolumesExtendTest-1983679099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:34 devstack sudo[97107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:37:34 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:35 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7c8f5b82-aaa4-4774-a0fa-5c46b26b7388 tempest-VolumesExtendTest-1983679099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.551s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:35 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-7c8f5b82-aaa4-4774-a0fa-5c46b26b7388 tempest-VolumesExtendTest-1983679099 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:37:35 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-7c8f5b82-aaa4-4774-a0fa-5c46b26b7388 tempest-VolumesExtendTest-1983679099 None] Deleted volume successfully.
Nov 07 02:37:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7c8f5b82-aaa4-4774-a0fa-5c46b26b7388 tempest-VolumesExtendTest-1983679099 None] Lock "cinder-8b282d5b-3535-4b85-bed3-89949d2e6019-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:40 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:37:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Flow 'volume_create_manager' (b7187d00-f278-4792-a7ef-a7945d8fc886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83cb3f39-efc1-4b5e-82a8-f74320df9d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83cb3f39-efc1-4b5e-82a8-f74320df9d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-200860200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d538714-688b-4d22-8120-85388ac92467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30ae1aab583410aa3de4619434d50bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:41Z,use_quota=True,user_id='5eaa9870c80548608ef49030140e600d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e434660-8819-41c0-b900-96e737960692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e434660-8819-41c0-b900-96e737960692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b36492-0401-47a5-b787-4cde6bc4895c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b36492-0401-47a5-b787-4cde6bc4895c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d538714-688b-4d22-8120-85388ac92467', 'volume_name': 'volume-5d538714-688b-4d22-8120-85388ac92467', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2ab352-373b-4e76-b4e2-d13fae788f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2ab352-373b-4e76-b4e2-d13fae788f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93d5a11-6624-4eda-9504-4fd6e269a581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:40 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Volume 5d538714-688b-4d22-8120-85388ac92467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d538714-688b-4d22-8120-85388ac92467', 'volume_size': 1}
Nov 07 02:37:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-200860200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d538714-688b-4d22-8120-85388ac92467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30ae1aab583410aa3de4619434d50bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:41Z,use_quota=True,user_id='5eaa9870c80548608ef49030140e600d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:37:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Creating volume 5d538714-688b-4d22-8120-85388ac92467 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:37:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:37:40 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:37:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d538714-688b-4d22-8120-85388ac92467 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:40 devstack sudo[97178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d538714-688b-4d22-8120-85388ac92467 1073741824
Nov 07 02:37:40 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:41 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d538714-688b-4d22-8120-85388ac92467 1073741824" returned: 0 in 0.628s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d538714-688b-4d22-8120-85388ac92467 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:41 devstack sudo[97184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d538714-688b-4d22-8120-85388ac92467
Nov 07 02:37:41 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:41 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d538714-688b-4d22-8120-85388ac92467" returned: 0 in 0.424s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:37:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:41 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93d5a11-6624-4eda-9504-4fd6e269a581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d538714-688b-4d22-8120-85388ac92467', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:41 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1789203-0f72-4c1b-8b46-f0a055372c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:42 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Volume volume-5d538714-688b-4d22-8120-85388ac92467 (5d538714-688b-4d22-8120-85388ac92467): created successfully
Nov 07 02:37:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1789203-0f72-4c1b-8b46-f0a055372c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Flow 'volume_create_manager' (b7187d00-f278-4792-a7ef-a7945d8fc886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:42 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-79537d21-79f4-4b26-a941-48462a8a2c06 tempest-AttachVolumeNegativeTest-1758341388 None] Created volume successfully.
Nov 07 02:37:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-2d889689-1439-4277-90ea-e5333e77c105 req-b6009f62-69bc-4ec6-9341-94cd784635ed tempest-AttachVolumeNegativeTest-1758341388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-2d889689-1439-4277-90ea-e5333e77c105 req-b6009f62-69bc-4ec6-9341-94cd784635ed tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-2d889689-1439-4277-90ea-e5333e77c105 req-b6009f62-69bc-4ec6-9341-94cd784635ed tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-2d889689-1439-4277-90ea-e5333e77c105 req-b6009f62-69bc-4ec6-9341-94cd784635ed tempest-AttachVolumeNegativeTest-1758341388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c', 'name': 'volume-5d538714-688b-4d22-8120-85388ac92467', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f2739ff7-7caf-4c49-9dc1-7c108267e214', 'enforce_multipath': True} {{(pid=87054) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:37:44 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-2d889689-1439-4277-90ea-e5333e77c105 req-b6009f62-69bc-4ec6-9341-94cd784635ed tempest-AttachVolumeNegativeTest-1758341388 None] attachment_update completed successfully.
Nov 07 02:37:46 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:37:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Flow 'volume_create_manager' (d6af6a0e-b21a-48fc-96b2-5b1d99cfae84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fefa20cf-c852-4595-85f0-273c239e553b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fefa20cf-c852-4595-85f0-273c239e553b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1290186321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66c683b-4efe-4658-9a53-0cfa7d80e93d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='033b5f27ae074f6a9581910092712928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:47Z,use_quota=True,user_id='aedcba1dcbdb41d88385cd98927ac51f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649f5537-a64f-416e-ab31-6527ddd0a7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649f5537-a64f-416e-ab31-6527ddd0a7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e61086ed-ec6d-44b6-9b46-4863e288afb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e61086ed-ec6d-44b6-9b46-4863e288afb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c66c683b-4efe-4658-9a53-0cfa7d80e93d', 'volume_name': 'volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82165dd0-17be-472b-a8c9-0911e03d2882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82165dd0-17be-472b-a8c9-0911e03d2882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449750c6-b669-4129-b15e-4aa7116b50b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:46 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Volume c66c683b-4efe-4658-9a53-0cfa7d80e93d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d', 'volume_size': 1}
Nov 07 02:37:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1290186321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66c683b-4efe-4658-9a53-0cfa7d80e93d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='033b5f27ae074f6a9581910092712928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:47Z,use_quota=True,user_id='aedcba1dcbdb41d88385cd98927ac51f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:37:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Creating volume c66c683b-4efe-4658-9a53-0cfa7d80e93d {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:37:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:37:46 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:37:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:47 devstack sudo[97204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d 1073741824
Nov 07 02:37:47 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:47 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-081997be-5435-45da-956b-46b74c1ee74e req-2e534991-6457-4406-9be7-f176e6f812b8 tempest-AttachVolumeNegativeTest-1758341388 None] Terminate volume connection completed successfully.
Nov 07 02:37:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-081997be-5435-45da-956b-46b74c1ee74e req-2e534991-6457-4406-9be7-f176e6f812b8 tempest-AttachVolumeNegativeTest-1758341388 None] Deleting attachment f2739ff7-7caf-4c49-9dc1-7c108267e214. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:37:47 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d 1073741824" returned: 0 in 0.592s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:47 devstack sudo[97213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d
Nov 07 02:37:47 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:47 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d" returned: 0 in 0.296s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:37:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449750c6-b669-4129-b15e-4aa7116b50b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4100f79e-eed4-4504-ab23-edaa9b14d28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:47 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Volume volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d (c66c683b-4efe-4658-9a53-0cfa7d80e93d): created successfully
Nov 07 02:37:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4100f79e-eed4-4504-ab23-edaa9b14d28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Flow 'volume_create_manager' (d6af6a0e-b21a-48fc-96b2-5b1d99cfae84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:47 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-445d61cf-3bde-4cb0-a744-0577d2e9f6e2 tempest-VolumesSnapshotListTestJSON-1929852474 None] Created volume successfully.
Nov 07 02:37:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1def751c-26a4-4546-a087-a4b3b6d6053f tempest-VolumesSnapshotListTestJSON-1929852474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1def751c-26a4-4546-a087-a4b3b6d6053f tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:49 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-1def751c-26a4-4546-a087-a4b3b6d6053f tempest-VolumesSnapshotListTestJSON-1929852474 None] Creating offline snapshot fa3fb157-e463-433c-8f74-1951d4c17077 of volume c66c683b-4efe-4658-9a53-0cfa7d80e93d {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:37:49 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[6135c807-53c7-4b94-bd08-c04321cc806c]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1def751c-26a4-4546-a087-a4b3b6d6053f tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:49 devstack sudo[97246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d
Nov 07 02:37:49 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:50 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:37:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Flow 'volume_create_manager' (c4827e8b-4733-493b-b07c-6112601a63b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf1daf1-7669-4b21-9d1a-57be79654c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:50 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf1daf1-7669-4b21-9d1a-57be79654c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-480002665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cabbe7a3-4059-4ed7-a8d4-749f3396cbd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff1794a264c4e109b860d19ae6b80e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:50Z,use_quota=True,user_id='a89799b23790417ea146ade92131d4e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a124c7-8704-4155-8f60-c5091c153fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a124c7-8704-4155-8f60-c5091c153fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b348fa-650c-4237-a789-7f17d4fb6004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:50 devstack cinder-volume[87054]: DEBUG cinder.image.glance [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Creating Keystone auth plugin from conf {{(pid=87054) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 07 02:37:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1def751c-26a4-4546-a087-a4b3b6d6053f tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d" returned: 0 in 0.669s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1def751c-26a4-4546-a087-a4b3b6d6053f tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:50 devstack sudo[97252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077 1G
Nov 07 02:37:50 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b348fa-650c-4237-a789-7f17d4fb6004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cabbe7a3-4059-4ed7-a8d4-749f3396cbd0', 'volume_name': 'volume-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0', 'volume_size': 1, 'image_id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567ec8d3497e4e06904abb9c1c036004', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 25, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72170a322f00>}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0430135d-64a8-4168-8f8a-ac3889ddf419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0430135d-64a8-4168-8f8a-ac3889ddf419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6a1908-6a70-4fdd-9019-4fa10aa32be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:50 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Volume cabbe7a3-4059-4ed7-a8d4-749f3396cbd0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0', 'volume_size': 1, 'image_id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567ec8d3497e4e06904abb9c1c036004', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 25, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72170a322f00>}
Nov 07 02:37:50 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Trying to clone cabbe7a3-4059-4ed7-a8d4-749f3396cbd0 from image b7a104a5-0b13-4f47-bea7-fab65f1346d5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}]). {{(pid=87054) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 07 02:37:50 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1def751c-26a4-4546-a087-a4b3b6d6053f tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077 1G" returned: 0 in 0.622s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1def751c-26a4-4546-a087-a4b3b6d6053f tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:50 devstack sudo[97260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077
Nov 07 02:37:50 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:51 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_t2_t7gfydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 07 02:37:51 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Image download 20.69 MB at 20.69 MB/s
Nov 07 02:37:51 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe88742-c843-44d3-b273-d076634be36f]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_t2_t7gfydevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:51 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1def751c-26a4-4546-a087-a4b3b6d6053f tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077" returned: 0 in 0.365s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:51 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-1def751c-26a4-4546-a087-a4b3b6d6053f tempest-VolumesSnapshotListTestJSON-1929852474 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077 is being set with open permissions: ugo+rw
Nov 07 02:37:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1def751c-26a4-4546-a087-a4b3b6d6053f tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:51 devstack sudo[97267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077
Nov 07 02:37:51 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:51 devstack sudo[97266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_t2_t7gfydevstack@QuobyteHD
Nov 07 02:37:51 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:51 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1def751c-26a4-4546-a087-a4b3b6d6053f tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077" returned: 0 in 0.299s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:51 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_t2_t7gfydevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:51 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Temporary image b7a104a5-0b13-4f47-bea7-fab65f1346d5 is fetched for user a89799b23790417ea146ade92131d4e6. {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 07 02:37:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1def751c-26a4-4546-a087-a4b3b6d6053f tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:51 devstack sudo[97274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.info
Nov 07 02:37:51 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:51 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[f292253f-9096-4731-a8fa-70798d48c4c7]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_t2_t7gfydevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:51 devstack sudo[97276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_t2_t7gfydevstack@QuobyteHD
Nov 07 02:37:51 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:51 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1def751c-26a4-4546-a087-a4b3b6d6053f tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.info" returned: 0 in 0.265s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:51 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-1def751c-26a4-4546-a087-a4b3b6d6053f tempest-VolumesSnapshotListTestJSON-1929852474 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.info is being set with open permissions: ugo+rw
Nov 07 02:37:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1def751c-26a4-4546-a087-a4b3b6d6053f tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:51 devstack sudo[97279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.info
Nov 07 02:37:51 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:51 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_t2_t7gfydevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:52 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1def751c-26a4-4546-a087-a4b3b6d6053f tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.info" returned: 0 in 0.255s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1def751c-26a4-4546-a087-a4b3b6d6053f tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.683s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.128s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-480002665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cabbe7a3-4059-4ed7-a8d4-749f3396cbd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff1794a264c4e109b860d19ae6b80e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:37:50Z,use_quota=True,user_id='a89799b23790417ea146ade92131d4e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:37:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Creating volume cabbe7a3-4059-4ed7-a8d4-749f3396cbd0 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:37:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:37:52 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:37:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:52 devstack sudo[97285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0 1073741824
Nov 07 02:37:52 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:52 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-1def751c-26a4-4546-a087-a4b3b6d6053f tempest-VolumesSnapshotListTestJSON-1929852474 None] Create snapshot completed successfully
Nov 07 02:37:52 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0 1073741824" returned: 0 in 0.458s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:52 devstack sudo[97291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0
Nov 07 02:37:52 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cd8aeaaa-9e5e-4e2e-9f86-97f7ec8882dd tempest-VolumesSnapshotListTestJSON-1929852474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:52 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0" returned: 0 in 0.321s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:37:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cd8aeaaa-9e5e-4e2e-9f86-97f7ec8882dd tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.137s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-cd8aeaaa-9e5e-4e2e-9f86-97f7ec8882dd tempest-VolumesSnapshotListTestJSON-1929852474 None] Creating offline snapshot c8173ec2-9933-4e66-ae15-894bd04cd4af of volume c66c683b-4efe-4658-9a53-0cfa7d80e93d {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:37:52 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Attempting download of b7a104a5-0b13-4f47-bea7-fab65f1346d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}])) to volume cabbe7a3-4059-4ed7-a8d4-749f3396cbd0. {{(pid=87054) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 07 02:37:52 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c96bd5-b6bd-45bc-9b7b-a722fadb6437]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cd8aeaaa-9e5e-4e2e-9f86-97f7ec8882dd tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:53 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e62433-22e5-477d-9392-2fd71ac02bc9]: (4, 'raw') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_n7nd53rj {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:53 devstack sudo[97294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077
Nov 07 02:37:53 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:53 devstack sudo[97295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_n7nd53rj
Nov 07 02:37:53 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:53 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cd8aeaaa-9e5e-4e2e-9f86-97f7ec8882dd tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077" returned: 0 in 0.425s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-cd8aeaaa-9e5e-4e2e-9f86-97f7ec8882dd tempest-VolumesSnapshotListTestJSON-1929852474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:37:53 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cd8aeaaa-9e5e-4e2e-9f86-97f7ec8882dd tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-510c7bbc-c126-407d-b184-d644582997d7 tempest-AttachVolumeNegativeTest-1758341388 None] Acquiring lock "cinder-5d538714-688b-4d22-8120-85388ac92467-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_n7nd53rj" returned: 0 in 0.406s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_n7nd53rj {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:53 devstack sudo[97327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af 1G
Nov 07 02:37:53 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-510c7bbc-c126-407d-b184-d644582997d7 tempest-AttachVolumeNegativeTest-1758341388 None] Lock "cinder-5d538714-688b-4d22-8120-85388ac92467-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-510c7bbc-c126-407d-b184-d644582997d7 tempest-AttachVolumeNegativeTest-1758341388 None] Acquiring lock "cinder-quobyte-5d538714-688b-4d22-8120-85388ac92467" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-510c7bbc-c126-407d-b184-d644582997d7 tempest-AttachVolumeNegativeTest-1758341388 None] Lock "cinder-quobyte-5d538714-688b-4d22-8120-85388ac92467" acquired by "delete_volume" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:53 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27522d8-2c3b-4719-9972-7dcb3b6fe524]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-510c7bbc-c126-407d-b184-d644582997d7 tempest-AttachVolumeNegativeTest-1758341388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d538714-688b-4d22-8120-85388ac92467 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:53 devstack sudo[97328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_n7nd53rj
Nov 07 02:37:53 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:53 devstack sudo[97330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d538714-688b-4d22-8120-85388ac92467
Nov 07 02:37:53 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:53 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_n7nd53rj" returned: 1 in 0.378s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_n7nd53rj' failed. Not Retrying. {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:37:53 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fa8c70-4317-405e-85de-5aa72c44a626]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_t2_t7gfydevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:53 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cd8aeaaa-9e5e-4e2e-9f86-97f7ec8882dd tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af 1G" returned: 0 in 0.474s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cd8aeaaa-9e5e-4e2e-9f86-97f7ec8882dd tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:53 devstack sudo[97341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af
Nov 07 02:37:53 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:53 devstack sudo[97339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_t2_t7gfydevstack@QuobyteHD
Nov 07 02:37:53 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:53 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-510c7bbc-c126-407d-b184-d644582997d7 tempest-AttachVolumeNegativeTest-1758341388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d538714-688b-4d22-8120-85388ac92467" returned: 0 in 0.422s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-510c7bbc-c126-407d-b184-d644582997d7 tempest-AttachVolumeNegativeTest-1758341388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d538714-688b-4d22-8120-85388ac92467 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:54 devstack sudo[97346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d538714-688b-4d22-8120-85388ac92467
Nov 07 02:37:54 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:54 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_t2_t7gfydevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] b7a104a5-0b13-4f47-bea7-fab65f1346d5 was qcow2, converting to qcow2 {{(pid=87054) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_t2_t7gfydevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:54 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cd8aeaaa-9e5e-4e2e-9f86-97f7ec8882dd tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af" returned: 0 in 0.323s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:54 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-cd8aeaaa-9e5e-4e2e-9f86-97f7ec8882dd tempest-VolumesSnapshotListTestJSON-1929852474 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af is being set with open permissions: ugo+rw
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cd8aeaaa-9e5e-4e2e-9f86-97f7ec8882dd tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:54 devstack sudo[97356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_t2_t7gfydevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0
Nov 07 02:37:54 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:54 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-510c7bbc-c126-407d-b184-d644582997d7 tempest-AttachVolumeNegativeTest-1758341388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d538714-688b-4d22-8120-85388ac92467" returned: 0 in 0.269s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:54 devstack sudo[97358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af
Nov 07 02:37:54 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-510c7bbc-c126-407d-b184-d644582997d7 tempest-AttachVolumeNegativeTest-1758341388 None] Lock "cinder-quobyte-5d538714-688b-4d22-8120-85388ac92467" released by "delete_volume" :: held 0.743s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-510c7bbc-c126-407d-b184-d644582997d7 tempest-AttachVolumeNegativeTest-1758341388 None] Created reservations ['87c88834-255d-4200-8fd9-a047628c2c9f', '5b052eb6-bcfe-4ffe-8f0a-f6a19f7c8640', '1334af7c-f33c-41cc-8b14-9b69e0f6a499', '05476924-d418-4aab-9fd3-b4cc31094e47'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-510c7bbc-c126-407d-b184-d644582997d7 tempest-AttachVolumeNegativeTest-1758341388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-510c7bbc-c126-407d-b184-d644582997d7 tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-510c7bbc-c126-407d-b184-d644582997d7 tempest-AttachVolumeNegativeTest-1758341388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-510c7bbc-c126-407d-b184-d644582997d7 tempest-AttachVolumeNegativeTest-1758341388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-510c7bbc-c126-407d-b184-d644582997d7 tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-510c7bbc-c126-407d-b184-d644582997d7 tempest-AttachVolumeNegativeTest-1758341388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:54 devstack sudo[97360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:37:54 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:54 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cd8aeaaa-9e5e-4e2e-9f86-97f7ec8882dd tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af" returned: 0 in 0.277s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cd8aeaaa-9e5e-4e2e-9f86-97f7ec8882dd tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.634s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:54 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-cd8aeaaa-9e5e-4e2e-9f86-97f7ec8882dd tempest-VolumesSnapshotListTestJSON-1929852474 None] Create snapshot completed successfully
Nov 07 02:37:54 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-510c7bbc-c126-407d-b184-d644582997d7 tempest-AttachVolumeNegativeTest-1758341388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.293s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-510c7bbc-c126-407d-b184-d644582997d7 tempest-AttachVolumeNegativeTest-1758341388 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:37:54 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-510c7bbc-c126-407d-b184-d644582997d7 tempest-AttachVolumeNegativeTest-1758341388 None] Deleted volume successfully.
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-510c7bbc-c126-407d-b184-d644582997d7 tempest-AttachVolumeNegativeTest-1758341388 None] Lock "cinder-5d538714-688b-4d22-8120-85388ac92467-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cba4cfbd-b08c-46be-835a-7c276b10a55b tempest-AttachVolumeNegativeTest-1758341388 None] Acquiring lock "cinder-5449b709-cfc5-4b95-9bca-a7094ff6c2cc-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cba4cfbd-b08c-46be-835a-7c276b10a55b tempest-AttachVolumeNegativeTest-1758341388 None] Lock "cinder-5449b709-cfc5-4b95-9bca-a7094ff6c2cc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cba4cfbd-b08c-46be-835a-7c276b10a55b tempest-AttachVolumeNegativeTest-1758341388 None] Acquiring lock "cinder-quobyte-5449b709-cfc5-4b95-9bca-a7094ff6c2cc" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cba4cfbd-b08c-46be-835a-7c276b10a55b tempest-AttachVolumeNegativeTest-1758341388 None] Lock "cinder-quobyte-5449b709-cfc5-4b95-9bca-a7094ff6c2cc" acquired by "delete_volume" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[454ba93b-561e-4f83-a271-90ded735cf48]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cba4cfbd-b08c-46be-835a-7c276b10a55b tempest-AttachVolumeNegativeTest-1758341388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5449b709-cfc5-4b95-9bca-a7094ff6c2cc {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:54 devstack sudo[97369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5449b709-cfc5-4b95-9bca-a7094ff6c2cc
Nov 07 02:37:54 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8e259e4d-2a9b-4a52-bc6e-e3b6471f1a53 tempest-VolumesSnapshotListTestJSON-1929852474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8e259e4d-2a9b-4a52-bc6e-e3b6471f1a53 tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-8e259e4d-2a9b-4a52-bc6e-e3b6471f1a53 tempest-VolumesSnapshotListTestJSON-1929852474 None] Creating offline snapshot fccc5e8a-d407-4879-b25f-87e87d2367dd of volume c66c683b-4efe-4658-9a53-0cfa7d80e93d {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:37:55 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ba1a66-61f3-4e44-a04c-c37114987f60]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8e259e4d-2a9b-4a52-bc6e-e3b6471f1a53 tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:55 devstack sudo[97386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af
Nov 07 02:37:55 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:55 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cba4cfbd-b08c-46be-835a-7c276b10a55b tempest-AttachVolumeNegativeTest-1758341388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5449b709-cfc5-4b95-9bca-a7094ff6c2cc" returned: 0 in 0.479s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cba4cfbd-b08c-46be-835a-7c276b10a55b tempest-AttachVolumeNegativeTest-1758341388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5449b709-cfc5-4b95-9bca-a7094ff6c2cc {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:55 devstack sudo[97411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5449b709-cfc5-4b95-9bca-a7094ff6c2cc
Nov 07 02:37:55 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:55 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8e259e4d-2a9b-4a52-bc6e-e3b6471f1a53 tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af" returned: 0 in 0.413s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-8e259e4d-2a9b-4a52-bc6e-e3b6471f1a53 tempest-VolumesSnapshotListTestJSON-1929852474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:37:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8e259e4d-2a9b-4a52-bc6e-e3b6471f1a53 tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fccc5e8a-d407-4879-b25f-87e87d2367dd 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:55 devstack sudo[97418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fccc5e8a-d407-4879-b25f-87e87d2367dd 1G
Nov 07 02:37:55 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:55 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cba4cfbd-b08c-46be-835a-7c276b10a55b tempest-AttachVolumeNegativeTest-1758341388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5449b709-cfc5-4b95-9bca-a7094ff6c2cc" returned: 0 in 0.359s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:55 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cba4cfbd-b08c-46be-835a-7c276b10a55b tempest-AttachVolumeNegativeTest-1758341388 None] Lock "cinder-quobyte-5449b709-cfc5-4b95-9bca-a7094ff6c2cc" released by "delete_volume" :: held 0.886s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:55 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-cba4cfbd-b08c-46be-835a-7c276b10a55b tempest-AttachVolumeNegativeTest-1758341388 None] Created reservations ['ed5e78be-28ca-4935-93a3-d93fffadc721', '179647c6-bc75-4e52-b408-b6deae0d8632', '00988d20-06d0-41e8-b1e3-6ce6c38b0874', '8250b9da-4426-4007-9ba2-42783a3e8990'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:37:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cba4cfbd-b08c-46be-835a-7c276b10a55b tempest-AttachVolumeNegativeTest-1758341388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cba4cfbd-b08c-46be-835a-7c276b10a55b tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cba4cfbd-b08c-46be-835a-7c276b10a55b tempest-AttachVolumeNegativeTest-1758341388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cba4cfbd-b08c-46be-835a-7c276b10a55b tempest-AttachVolumeNegativeTest-1758341388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cba4cfbd-b08c-46be-835a-7c276b10a55b tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cba4cfbd-b08c-46be-835a-7c276b10a55b tempest-AttachVolumeNegativeTest-1758341388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:55 devstack sudo[97424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:37:55 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-fa642a8f-d815-4ebf-a6f6-edbcb8ba301c tempest-AttachVolumeNegativeTest-1758341388 None] Acquiring lock "cinder-94a2b6bf-553d-424b-aa0f-3247e607b7ab-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-fa642a8f-d815-4ebf-a6f6-edbcb8ba301c tempest-AttachVolumeNegativeTest-1758341388 None] Lock "cinder-94a2b6bf-553d-424b-aa0f-3247e607b7ab-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:56 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8e259e4d-2a9b-4a52-bc6e-e3b6471f1a53 tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fccc5e8a-d407-4879-b25f-87e87d2367dd 1G" returned: 0 in 0.653s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8e259e4d-2a9b-4a52-bc6e-e3b6471f1a53 tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fccc5e8a-d407-4879-b25f-87e87d2367dd {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:56 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-fa642a8f-d815-4ebf-a6f6-edbcb8ba301c tempest-AttachVolumeNegativeTest-1758341388 None] Acquiring lock "cinder-quobyte-94a2b6bf-553d-424b-aa0f-3247e607b7ab" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cba4cfbd-b08c-46be-835a-7c276b10a55b tempest-AttachVolumeNegativeTest-1758341388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.370s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-cba4cfbd-b08c-46be-835a-7c276b10a55b tempest-AttachVolumeNegativeTest-1758341388 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:37:56 devstack sudo[97428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fccc5e8a-d407-4879-b25f-87e87d2367dd
Nov 07 02:37:56 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-cba4cfbd-b08c-46be-835a-7c276b10a55b tempest-AttachVolumeNegativeTest-1758341388 None] Deleted volume successfully.
Nov 07 02:37:56 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-fa642a8f-d815-4ebf-a6f6-edbcb8ba301c tempest-AttachVolumeNegativeTest-1758341388 None] Lock "cinder-quobyte-94a2b6bf-553d-424b-aa0f-3247e607b7ab" acquired by "delete_volume" :: waited 0.027s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cba4cfbd-b08c-46be-835a-7c276b10a55b tempest-AttachVolumeNegativeTest-1758341388 None] Lock "cinder-5449b709-cfc5-4b95-9bca-a7094ff6c2cc-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f66504a-7338-41b3-98e3-4a3d6101eb6b]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fa642a8f-d815-4ebf-a6f6-edbcb8ba301c tempest-AttachVolumeNegativeTest-1758341388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-94a2b6bf-553d-424b-aa0f-3247e607b7ab {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:56 devstack sudo[97430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-94a2b6bf-553d-424b-aa0f-3247e607b7ab
Nov 07 02:37:56 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:56 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_t2_t7gfydevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0" returned: 0 in 2.254s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_t2_t7gfydevstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0 {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:37:56 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Converted 112.00 MB image at 49.67 MB/s
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:56 devstack sudo[97432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0 1G
Nov 07 02:37:56 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:56 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8e259e4d-2a9b-4a52-bc6e-e3b6471f1a53 tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fccc5e8a-d407-4879-b25f-87e87d2367dd" returned: 0 in 0.346s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:56 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-8e259e4d-2a9b-4a52-bc6e-e3b6471f1a53 tempest-VolumesSnapshotListTestJSON-1929852474 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fccc5e8a-d407-4879-b25f-87e87d2367dd is being set with open permissions: ugo+rw
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8e259e4d-2a9b-4a52-bc6e-e3b6471f1a53 tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fccc5e8a-d407-4879-b25f-87e87d2367dd {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:56 devstack sudo[97437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fccc5e8a-d407-4879-b25f-87e87d2367dd
Nov 07 02:37:56 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:56 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fa642a8f-d815-4ebf-a6f6-edbcb8ba301c tempest-AttachVolumeNegativeTest-1758341388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-94a2b6bf-553d-424b-aa0f-3247e607b7ab" returned: 0 in 0.400s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fa642a8f-d815-4ebf-a6f6-edbcb8ba301c tempest-AttachVolumeNegativeTest-1758341388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-94a2b6bf-553d-424b-aa0f-3247e607b7ab {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:56 devstack sudo[97444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-94a2b6bf-553d-424b-aa0f-3247e607b7ab
Nov 07 02:37:56 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:56 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0 1G" returned: 0 in 0.368s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Downloaded image b7a104a5-0b13-4f47-bea7-fab65f1346d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}])) to volume cabbe7a3-4059-4ed7-a8d4-749f3396cbd0 successfully. {{(pid=87054) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Temporary image b7a104a5-0b13-4f47-bea7-fab65f1346d5 for user a89799b23790417ea146ade92131d4e6 is deleted. {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Marking volume cabbe7a3-4059-4ed7-a8d4-749f3396cbd0 as bootable. {{(pid=87054) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Copying metadata from image b7a104a5-0b13-4f47-bea7-fab65f1346d5 to cabbe7a3-4059-4ed7-a8d4-749f3396cbd0. {{(pid=87054) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Creating volume glance metadata for volume cabbe7a3-4059-4ed7-a8d4-749f3396cbd0 backed by image b7a104a5-0b13-4f47-bea7-fab65f1346d5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87054) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 07 02:37:56 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8e259e4d-2a9b-4a52-bc6e-e3b6471f1a53 tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fccc5e8a-d407-4879-b25f-87e87d2367dd" returned: 0 in 0.269s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8e259e4d-2a9b-4a52-bc6e-e3b6471f1a53 tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.832s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:56 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-8e259e4d-2a9b-4a52-bc6e-e3b6471f1a53 tempest-VolumesSnapshotListTestJSON-1929852474 None] Create snapshot completed successfully
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6a1908-6a70-4fdd-9019-4fa10aa32be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0', 'volume_size': 1, 'image_id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567ec8d3497e4e06904abb9c1c036004', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 25, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72170a322f00>}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:56 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893d6c55-4258-49a9-b696-e180670d1adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:37:57 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fa642a8f-d815-4ebf-a6f6-edbcb8ba301c tempest-AttachVolumeNegativeTest-1758341388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-94a2b6bf-553d-424b-aa0f-3247e607b7ab" returned: 0 in 0.286s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:57 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-fa642a8f-d815-4ebf-a6f6-edbcb8ba301c tempest-AttachVolumeNegativeTest-1758341388 None] Lock "cinder-quobyte-94a2b6bf-553d-424b-aa0f-3247e607b7ab" released by "delete_volume" :: held 0.749s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:57 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Volume volume-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0 (cabbe7a3-4059-4ed7-a8d4-749f3396cbd0): created successfully
Nov 07 02:37:57 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893d6c55-4258-49a9-b696-e180670d1adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:37:57 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Flow 'volume_create_manager' (c4827e8b-4733-493b-b07c-6112601a63b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:37:57 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ac17015c-2154-4be6-a861-773cab790eb7 tempest-VolumesImageMetadata-1561998682 None] Created volume successfully.
Nov 07 02:37:57 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-fa642a8f-d815-4ebf-a6f6-edbcb8ba301c tempest-AttachVolumeNegativeTest-1758341388 None] Created reservations ['0157905e-1244-4541-ba6c-118659de3ccd', '8b950f53-a93f-406e-88d3-ae45de129ce5', 'f48633c5-00d0-4c3b-b279-08989f126ba1', '030ab3fa-01c3-440b-a86d-c64e43f98129'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:37:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-fa642a8f-d815-4ebf-a6f6-edbcb8ba301c tempest-AttachVolumeNegativeTest-1758341388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-fa642a8f-d815-4ebf-a6f6-edbcb8ba301c tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:57 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-fa642a8f-d815-4ebf-a6f6-edbcb8ba301c tempest-AttachVolumeNegativeTest-1758341388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:57 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-fa642a8f-d815-4ebf-a6f6-edbcb8ba301c tempest-AttachVolumeNegativeTest-1758341388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-fa642a8f-d815-4ebf-a6f6-edbcb8ba301c tempest-AttachVolumeNegativeTest-1758341388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fa642a8f-d815-4ebf-a6f6-edbcb8ba301c tempest-AttachVolumeNegativeTest-1758341388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:57 devstack sudo[97449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:37:57 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:57 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fa642a8f-d815-4ebf-a6f6-edbcb8ba301c tempest-AttachVolumeNegativeTest-1758341388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.272s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:57 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-fa642a8f-d815-4ebf-a6f6-edbcb8ba301c tempest-AttachVolumeNegativeTest-1758341388 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:37:57 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-fa642a8f-d815-4ebf-a6f6-edbcb8ba301c tempest-AttachVolumeNegativeTest-1758341388 None] Deleted volume successfully.
Nov 07 02:37:57 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-fa642a8f-d815-4ebf-a6f6-edbcb8ba301c tempest-AttachVolumeNegativeTest-1758341388 None] Lock "cinder-94a2b6bf-553d-424b-aa0f-3247e607b7ab-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:58 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dbf3f6d6-21ec-45e9-8125-8927b2efcd4f tempest-VolumesImageMetadata-1561998682 None] Acquiring lock "cinder-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:58 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dbf3f6d6-21ec-45e9-8125-8927b2efcd4f tempest-VolumesImageMetadata-1561998682 None] Lock "cinder-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:58 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dbf3f6d6-21ec-45e9-8125-8927b2efcd4f tempest-VolumesImageMetadata-1561998682 None] Acquiring lock "cinder-quobyte-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:58 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dbf3f6d6-21ec-45e9-8125-8927b2efcd4f tempest-VolumesImageMetadata-1561998682 None] Lock "cinder-quobyte-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0" acquired by "delete_volume" :: waited 0.057s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:58 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e130c4b-02ad-4b19-be11-4f898739f45e]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dbf3f6d6-21ec-45e9-8125-8927b2efcd4f tempest-VolumesImageMetadata-1561998682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:58 devstack sudo[97453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0
Nov 07 02:37:58 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:58 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-75a25a73-c487-4ff2-8545-11be98115acc tempest-VolumesSnapshotListTestJSON-1929852474 None] Acquiring lock "cinder-fccc5e8a-d407-4879-b25f-87e87d2367dd-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:58 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-75a25a73-c487-4ff2-8545-11be98115acc tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "cinder-fccc5e8a-d407-4879-b25f-87e87d2367dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:58 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-75a25a73-c487-4ff2-8545-11be98115acc tempest-VolumesSnapshotListTestJSON-1929852474 None] Acquiring lock "cinder-quobyte-c66c683b-4efe-4658-9a53-0cfa7d80e93d" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:58 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-75a25a73-c487-4ff2-8545-11be98115acc tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "cinder-quobyte-c66c683b-4efe-4658-9a53-0cfa7d80e93d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:58 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-75a25a73-c487-4ff2-8545-11be98115acc tempest-VolumesSnapshotListTestJSON-1929852474 None] Acquiring lock "cinder-quobyte-fccc5e8a-d407-4879-b25f-87e87d2367dd" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:37:58 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-75a25a73-c487-4ff2-8545-11be98115acc tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "cinder-quobyte-fccc5e8a-d407-4879-b25f-87e87d2367dd" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:37:58 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:58 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-75a25a73-c487-4ff2-8545-11be98115acc tempest-VolumesSnapshotListTestJSON-1929852474 None] Deleting offline snapshot fccc5e8a-d407-4879-b25f-87e87d2367dd of volume c66c683b-4efe-4658-9a53-0cfa7d80e93d {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:37:58 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-75a25a73-c487-4ff2-8545-11be98115acc tempest-VolumesSnapshotListTestJSON-1929852474 None] snapshot_file for this snap is: volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fccc5e8a-d407-4879-b25f-87e87d2367dd {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:37:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dbf3f6d6-21ec-45e9-8125-8927b2efcd4f tempest-VolumesImageMetadata-1561998682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0" returned: 0 in 0.591s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dbf3f6d6-21ec-45e9-8125-8927b2efcd4f tempest-VolumesImageMetadata-1561998682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:58 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd589b7-2320-451a-b143-013d1c3e1d8c]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-75a25a73-c487-4ff2-8545-11be98115acc tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fccc5e8a-d407-4879-b25f-87e87d2367dd {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:58 devstack sudo[97458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0
Nov 07 02:37:58 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:59 devstack sudo[97459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fccc5e8a-d407-4879-b25f-87e87d2367dd
Nov 07 02:37:59 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:59 devstack sudo[97463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:37:59 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:59 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dbf3f6d6-21ec-45e9-8125-8927b2efcd4f tempest-VolumesImageMetadata-1561998682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0" returned: 0 in 0.320s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dbf3f6d6-21ec-45e9-8125-8927b2efcd4f tempest-VolumesImageMetadata-1561998682 None] Lock "cinder-quobyte-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0" released by "delete_volume" :: held 0.994s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-dbf3f6d6-21ec-45e9-8125-8927b2efcd4f tempest-VolumesImageMetadata-1561998682 None] Created reservations ['32327313-f1c4-469a-97df-c9aa14e701fa', '61b2a955-d847-4ae2-93b9-acd242483b9b', '678c904d-1cd8-4823-aaec-ebc2d732f6c2', '94c79aad-b630-4d8b-b8ff-43b0f256d07a'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:37:59 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-75a25a73-c487-4ff2-8545-11be98115acc tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fccc5e8a-d407-4879-b25f-87e87d2367dd" returned: 0 in 0.488s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-75a25a73-c487-4ff2-8545-11be98115acc tempest-VolumesSnapshotListTestJSON-1929852474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db3332e-0bfb-44a0-96fe-9c70627b5398]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-75a25a73-c487-4ff2-8545-11be98115acc tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dbf3f6d6-21ec-45e9-8125-8927b2efcd4f tempest-VolumesImageMetadata-1561998682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dbf3f6d6-21ec-45e9-8125-8927b2efcd4f tempest-VolumesImageMetadata-1561998682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-dbf3f6d6-21ec-45e9-8125-8927b2efcd4f tempest-VolumesImageMetadata-1561998682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-dbf3f6d6-21ec-45e9-8125-8927b2efcd4f tempest-VolumesImageMetadata-1561998682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dbf3f6d6-21ec-45e9-8125-8927b2efcd4f tempest-VolumesImageMetadata-1561998682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dbf3f6d6-21ec-45e9-8125-8927b2efcd4f tempest-VolumesImageMetadata-1561998682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:59 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.386s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 28 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>, <Thread(fd_logger, started daemon 125443282798592)>, <Thread(privsep_reader, started daemon 125443284556288)>, <Thread(tpool_thread_0, started daemon 125443276445376)>, <Thread(tpool_thread_1, started daemon 125443268036288)>, <Thread(tpool_thread_2, started daemon 125443259627200)>, <Thread(tpool_thread_3, started daemon 125443251218112)>, <Thread(tpool_thread_4, started daemon 125443242809024)>, <Thread(tpool_thread_5, started daemon 125443234399936)>, <Thread(tpool_thread_6, started daemon 125443225990848)>, <Thread(tpool_thread_7, started daemon 125443217581760)>, <Thread(tpool_thread_8, started daemon 125443209172672)>, <Thread(tpool_thread_9, started daemon 125443200763584)>, <Thread(tpool_thread_10, started daemon 125443192354496)>, <Thread(tpool_thread_11, started daemon 125443183945408)>, <Thread(tpool_thread_12, started daemon 125443175536320)>, <Thread(tpool_thread_13, started daemon 125443167127232)>, <Thread(tpool_thread_14, started daemon 125443158718144)>, <Thread(tpool_thread_15, started daemon 125443150309056)>, <Thread(tpool_thread_16, started daemon 125443141899968)>, <Thread(tpool_thread_17, started daemon 125443133490880)>, <Thread(tpool_thread_18, started daemon 125443125081792)>, <Thread(tpool_thread_19, started daemon 125443116672704)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:37:59 devstack sudo[97472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:37:59 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:59 devstack sudo[97471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af
Nov 07 02:37:59 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:37:59 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dbf3f6d6-21ec-45e9-8125-8927b2efcd4f tempest-VolumesImageMetadata-1561998682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.264s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-dbf3f6d6-21ec-45e9-8125-8927b2efcd4f tempest-VolumesImageMetadata-1561998682 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:37:59 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-dbf3f6d6-21ec-45e9-8125-8927b2efcd4f tempest-VolumesImageMetadata-1561998682 None] Deleted volume successfully.
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dbf3f6d6-21ec-45e9-8125-8927b2efcd4f tempest-VolumesImageMetadata-1561998682 None] Lock "cinder-cabbe7a3-4059-4ed7-a8d4-749f3396cbd0-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:37:59 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-75a25a73-c487-4ff2-8545-11be98115acc tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af" returned: 0 in 0.419s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-75a25a73-c487-4ff2-8545-11be98115acc tempest-VolumesSnapshotListTestJSON-1929852474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:37:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-75a25a73-c487-4ff2-8545-11be98115acc tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fccc5e8a-d407-4879-b25f-87e87d2367dd {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:37:59 devstack sudo[97479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fccc5e8a-d407-4879-b25f-87e87d2367dd
Nov 07 02:37:59 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:00 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-75a25a73-c487-4ff2-8545-11be98115acc tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fccc5e8a-d407-4879-b25f-87e87d2367dd" returned: 0 in 0.498s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-75a25a73-c487-4ff2-8545-11be98115acc tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fccc5e8a-d407-4879-b25f-87e87d2367dd {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:00 devstack sudo[97485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fccc5e8a-d407-4879-b25f-87e87d2367dd
Nov 07 02:38:00 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:00 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-75a25a73-c487-4ff2-8545-11be98115acc tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fccc5e8a-d407-4879-b25f-87e87d2367dd" returned: 0 in 0.283s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:00 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-75a25a73-c487-4ff2-8545-11be98115acc tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "cinder-quobyte-fccc5e8a-d407-4879-b25f-87e87d2367dd" released by "_delete_snapshot" :: held 1.811s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:00 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-75a25a73-c487-4ff2-8545-11be98115acc tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "cinder-quobyte-c66c683b-4efe-4658-9a53-0cfa7d80e93d" released by "delete_snapshot" :: held 1.846s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:00 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-75a25a73-c487-4ff2-8545-11be98115acc tempest-VolumesSnapshotListTestJSON-1929852474 None] Created reservations ['3de6d7b3-3cab-42a7-a67b-af814baf5c4c', '197512a8-5af4-4c86-a7be-b5bf9bb179af', '46e5a450-b1f9-420a-b553-39c1c1835b53', '1f6df7c4-26ba-46f8-b94e-6de6085def97'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:38:00 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-75a25a73-c487-4ff2-8545-11be98115acc tempest-VolumesSnapshotListTestJSON-1929852474 None] Delete snapshot completed successfully.
Nov 07 02:38:00 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-75a25a73-c487-4ff2-8545-11be98115acc tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "cinder-fccc5e8a-d407-4879-b25f-87e87d2367dd-delete_snapshot" released by "delete_snapshot" :: held 2.025s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6cdf27cf-0cf7-469e-9937-dcb7d85d2120 tempest-VolumesSnapshotListTestJSON-1929852474 None] Acquiring lock "cinder-c8173ec2-9933-4e66-ae15-894bd04cd4af-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6cdf27cf-0cf7-469e-9937-dcb7d85d2120 tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "cinder-c8173ec2-9933-4e66-ae15-894bd04cd4af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6cdf27cf-0cf7-469e-9937-dcb7d85d2120 tempest-VolumesSnapshotListTestJSON-1929852474 None] Acquiring lock "cinder-quobyte-c66c683b-4efe-4658-9a53-0cfa7d80e93d" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6cdf27cf-0cf7-469e-9937-dcb7d85d2120 tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "cinder-quobyte-c66c683b-4efe-4658-9a53-0cfa7d80e93d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6cdf27cf-0cf7-469e-9937-dcb7d85d2120 tempest-VolumesSnapshotListTestJSON-1929852474 None] Acquiring lock "cinder-quobyte-c8173ec2-9933-4e66-ae15-894bd04cd4af" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6cdf27cf-0cf7-469e-9937-dcb7d85d2120 tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "cinder-quobyte-c8173ec2-9933-4e66-ae15-894bd04cd4af" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:01 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-6cdf27cf-0cf7-469e-9937-dcb7d85d2120 tempest-VolumesSnapshotListTestJSON-1929852474 None] Deleting offline snapshot c8173ec2-9933-4e66-ae15-894bd04cd4af of volume c66c683b-4efe-4658-9a53-0cfa7d80e93d {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:38:01 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-6cdf27cf-0cf7-469e-9937-dcb7d85d2120 tempest-VolumesSnapshotListTestJSON-1929852474 None] snapshot_file for this snap is: volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:38:01 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b68d90e-c3db-4eaa-9313-b07f76396c67]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6cdf27cf-0cf7-469e-9937-dcb7d85d2120 tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:01 devstack sudo[97491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af
Nov 07 02:38:01 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:01 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-9e725b22-862a-4d62-98a6-3672915da571 req-42006e59-b0d6-4ed0-94f1-a174a182e5e0 tempest-AttachVolumeTestJSON-63735962 None] Terminate volume connection completed successfully.
Nov 07 02:38:01 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-9e725b22-862a-4d62-98a6-3672915da571 req-42006e59-b0d6-4ed0-94f1-a174a182e5e0 tempest-AttachVolumeTestJSON-63735962 None] Deleting attachment 764dc2b0-d4d0-4d0b-881e-007e61a6cbb6. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:38:01 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6cdf27cf-0cf7-469e-9937-dcb7d85d2120 tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af" returned: 0 in 0.570s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:01 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-6cdf27cf-0cf7-469e-9937-dcb7d85d2120 tempest-VolumesSnapshotListTestJSON-1929852474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:38:01 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[0272780a-44e3-45c4-abee-a536dbefa750]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6cdf27cf-0cf7-469e-9937-dcb7d85d2120 tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:01 devstack sudo[97499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077
Nov 07 02:38:01 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:02 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6cdf27cf-0cf7-469e-9937-dcb7d85d2120 tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077" returned: 0 in 0.506s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:02 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-6cdf27cf-0cf7-469e-9937-dcb7d85d2120 tempest-VolumesSnapshotListTestJSON-1929852474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:38:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6cdf27cf-0cf7-469e-9937-dcb7d85d2120 tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:02 devstack sudo[97505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af
Nov 07 02:38:02 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:02 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6cdf27cf-0cf7-469e-9937-dcb7d85d2120 tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af" returned: 0 in 0.539s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6cdf27cf-0cf7-469e-9937-dcb7d85d2120 tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:02 devstack sudo[97515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af
Nov 07 02:38:02 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:03 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6cdf27cf-0cf7-469e-9937-dcb7d85d2120 tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.c8173ec2-9933-4e66-ae15-894bd04cd4af" returned: 0 in 0.271s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:03 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6cdf27cf-0cf7-469e-9937-dcb7d85d2120 tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "cinder-quobyte-c8173ec2-9933-4e66-ae15-894bd04cd4af" released by "_delete_snapshot" :: held 2.071s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:03 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6cdf27cf-0cf7-469e-9937-dcb7d85d2120 tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "cinder-quobyte-c66c683b-4efe-4658-9a53-0cfa7d80e93d" released by "delete_snapshot" :: held 2.108s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:03 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-6cdf27cf-0cf7-469e-9937-dcb7d85d2120 tempest-VolumesSnapshotListTestJSON-1929852474 None] Created reservations ['382f57a0-aae3-40db-ac27-7d99b9e64fcf', '9b9efa3e-3559-45ff-85ac-69d1ae6e0b26', 'b208368f-0707-482b-b4c3-d567d82fb7c0', '5aced182-8d74-462f-8d06-19a0e9cafbbd'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:38:03 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-6cdf27cf-0cf7-469e-9937-dcb7d85d2120 tempest-VolumesSnapshotListTestJSON-1929852474 None] Delete snapshot completed successfully.
Nov 07 02:38:03 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6cdf27cf-0cf7-469e-9937-dcb7d85d2120 tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "cinder-c8173ec2-9933-4e66-ae15-894bd04cd4af-delete_snapshot" released by "delete_snapshot" :: held 2.294s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-29d3c9cc-3762-4581-ae3d-4ee16baffa5a tempest-VolumesSnapshotListTestJSON-1929852474 None] Acquiring lock "cinder-fa3fb157-e463-433c-8f74-1951d4c17077-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-29d3c9cc-3762-4581-ae3d-4ee16baffa5a tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "cinder-fa3fb157-e463-433c-8f74-1951d4c17077-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-29d3c9cc-3762-4581-ae3d-4ee16baffa5a tempest-VolumesSnapshotListTestJSON-1929852474 None] Acquiring lock "cinder-quobyte-c66c683b-4efe-4658-9a53-0cfa7d80e93d" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-29d3c9cc-3762-4581-ae3d-4ee16baffa5a tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "cinder-quobyte-c66c683b-4efe-4658-9a53-0cfa7d80e93d" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-29d3c9cc-3762-4581-ae3d-4ee16baffa5a tempest-VolumesSnapshotListTestJSON-1929852474 None] Acquiring lock "cinder-quobyte-fa3fb157-e463-433c-8f74-1951d4c17077" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-29d3c9cc-3762-4581-ae3d-4ee16baffa5a tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "cinder-quobyte-fa3fb157-e463-433c-8f74-1951d4c17077" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-29d3c9cc-3762-4581-ae3d-4ee16baffa5a tempest-VolumesSnapshotListTestJSON-1929852474 None] Deleting offline snapshot fa3fb157-e463-433c-8f74-1951d4c17077 of volume c66c683b-4efe-4658-9a53-0cfa7d80e93d {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:38:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-29d3c9cc-3762-4581-ae3d-4ee16baffa5a tempest-VolumesSnapshotListTestJSON-1929852474 None] snapshot_file for this snap is: volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:38:04 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5d6a41-92f4-4d0a-9671-374a0dd49194]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-29d3c9cc-3762-4581-ae3d-4ee16baffa5a tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:04 devstack sudo[97518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077
Nov 07 02:38:04 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:05 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-29d3c9cc-3762-4581-ae3d-4ee16baffa5a tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077" returned: 0 in 0.512s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-29d3c9cc-3762-4581-ae3d-4ee16baffa5a tempest-VolumesSnapshotListTestJSON-1929852474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:38:05 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[605a45c4-311f-42c8-9c14-ad05423b38ce]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-29d3c9cc-3762-4581-ae3d-4ee16baffa5a tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:05 devstack sudo[97523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d
Nov 07 02:38:05 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:05 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-29d3c9cc-3762-4581-ae3d-4ee16baffa5a tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d" returned: 0 in 0.717s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-29d3c9cc-3762-4581-ae3d-4ee16baffa5a tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:05 devstack sudo[97545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077
Nov 07 02:38:05 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:05 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Flow 'volume_create_manager' (4eabc7f4-6a62-40a3-96f3-90f835200e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f36229-32a9-4c4a-b507-fd8520a72c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f36229-32a9-4c4a-b507-fd8520a72c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-417326031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=891001db-3c5f-4256-a517-ebf92996368c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba2f7887dec42089c10a205681034fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:06Z,use_quota=True,user_id='8b5bc2da676a4811b198f3a561d879d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11783c0c-56f0-41fb-ae10-dc7e86b1f18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11783c0c-56f0-41fb-ae10-dc7e86b1f18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf7d1e3-29f5-46b0-abab-01f94fdc6edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf7d1e3-29f5-46b0-abab-01f94fdc6edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '891001db-3c5f-4256-a517-ebf92996368c', 'volume_name': 'volume-891001db-3c5f-4256-a517-ebf92996368c', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5659ef52-2de6-4129-8e12-809abd60ec3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5659ef52-2de6-4129-8e12-809abd60ec3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa57c97d-3fe6-4cac-ae80-913c9c5b7d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:06 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Volume 891001db-3c5f-4256-a517-ebf92996368c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-891001db-3c5f-4256-a517-ebf92996368c', 'volume_size': 1}
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-417326031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=891001db-3c5f-4256-a517-ebf92996368c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba2f7887dec42089c10a205681034fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:06Z,use_quota=True,user_id='8b5bc2da676a4811b198f3a561d879d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Creating volume 891001db-3c5f-4256-a517-ebf92996368c {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:38:06 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-891001db-3c5f-4256-a517-ebf92996368c 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:06 devstack sudo[97553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-891001db-3c5f-4256-a517-ebf92996368c 1073741824
Nov 07 02:38:06 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:06 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-29d3c9cc-3762-4581-ae3d-4ee16baffa5a tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077" returned: 0 in 0.566s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-29d3c9cc-3762-4581-ae3d-4ee16baffa5a tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:06 devstack sudo[97563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077
Nov 07 02:38:06 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:06 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-29d3c9cc-3762-4581-ae3d-4ee16baffa5a tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d.fa3fb157-e463-433c-8f74-1951d4c17077" returned: 0 in 0.524s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-29d3c9cc-3762-4581-ae3d-4ee16baffa5a tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "cinder-quobyte-fa3fb157-e463-433c-8f74-1951d4c17077" released by "_delete_snapshot" :: held 2.558s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-29d3c9cc-3762-4581-ae3d-4ee16baffa5a tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "cinder-quobyte-c66c683b-4efe-4658-9a53-0cfa7d80e93d" released by "delete_snapshot" :: held 2.607s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:07 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-891001db-3c5f-4256-a517-ebf92996368c 1073741824" returned: 0 in 0.937s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:07 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-29d3c9cc-3762-4581-ae3d-4ee16baffa5a tempest-VolumesSnapshotListTestJSON-1929852474 None] Created reservations ['cc0aec2f-61c6-4067-a83e-3694ad8790f1', 'a9539c79-9cb3-47d2-a35d-24e8a16ecff9', '2594e7f8-2f7b-421a-ab2a-e60e11537ee7', '7925ea61-49c3-4792-9fdd-fd7a6d27a82c'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:38:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-891001db-3c5f-4256-a517-ebf92996368c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:07 devstack sudo[97622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-891001db-3c5f-4256-a517-ebf92996368c
Nov 07 02:38:07 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:07 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-29d3c9cc-3762-4581-ae3d-4ee16baffa5a tempest-VolumesSnapshotListTestJSON-1929852474 None] Delete snapshot completed successfully.
Nov 07 02:38:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-29d3c9cc-3762-4581-ae3d-4ee16baffa5a tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "cinder-fa3fb157-e463-433c-8f74-1951d4c17077-delete_snapshot" released by "delete_snapshot" :: held 2.862s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:07 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-891001db-3c5f-4256-a517-ebf92996368c" returned: 0 in 0.444s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:07 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:38:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa57c97d-3fe6-4cac-ae80-913c9c5b7d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-891001db-3c5f-4256-a517-ebf92996368c', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ef007f-eaa6-4be9-9881-f06368268eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:07 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Volume volume-891001db-3c5f-4256-a517-ebf92996368c (891001db-3c5f-4256-a517-ebf92996368c): created successfully
Nov 07 02:38:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ef007f-eaa6-4be9-9881-f06368268eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Flow 'volume_create_manager' (4eabc7f4-6a62-40a3-96f3-90f835200e41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:07 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-e1b59e94-2bbf-4591-8aa5-3f3def3e9817 tempest-VolumesNegativeTest-1184575541 None] Created volume successfully.
Nov 07 02:38:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-97e62246-65ce-4d87-931c-296f07556364 tempest-VolumesSnapshotListTestJSON-1929852474 None] Acquiring lock "cinder-c66c683b-4efe-4658-9a53-0cfa7d80e93d-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-97e62246-65ce-4d87-931c-296f07556364 tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "cinder-c66c683b-4efe-4658-9a53-0cfa7d80e93d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-97e62246-65ce-4d87-931c-296f07556364 tempest-VolumesSnapshotListTestJSON-1929852474 None] Acquiring lock "cinder-quobyte-c66c683b-4efe-4658-9a53-0cfa7d80e93d" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-97e62246-65ce-4d87-931c-296f07556364 tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "cinder-quobyte-c66c683b-4efe-4658-9a53-0cfa7d80e93d" acquired by "delete_volume" :: waited 0.047s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:08 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[34edb1f3-181c-442a-85c2-9793c31e061e]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-97e62246-65ce-4d87-931c-296f07556364 tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:08 devstack sudo[97641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d
Nov 07 02:38:08 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:08 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-9c43ee35-9ab7-4f6f-9e56-f71eca8b0ada tempest-GroupSnapshotsV319Test-1675761457 None] Group tempest-GroupSnapshotsV319Test-Group-1248473996: creating
Nov 07 02:38:08 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-9c43ee35-9ab7-4f6f-9e56-f71eca8b0ada tempest-GroupSnapshotsV319Test-1675761457 None] Group tempest-GroupSnapshotsV319Test-Group-1248473996: created successfully
Nov 07 02:38:08 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-9c43ee35-9ab7-4f6f-9e56-f71eca8b0ada tempest-GroupSnapshotsV319Test-1675761457 None] Create group completed successfully.
Nov 07 02:38:08 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-97e62246-65ce-4d87-931c-296f07556364 tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d" returned: 0 in 0.788s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-97e62246-65ce-4d87-931c-296f07556364 tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:08 devstack sudo[97648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d
Nov 07 02:38:08 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:09 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-97e62246-65ce-4d87-931c-296f07556364 tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c66c683b-4efe-4658-9a53-0cfa7d80e93d" returned: 0 in 0.372s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:09 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-97e62246-65ce-4d87-931c-296f07556364 tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "cinder-quobyte-c66c683b-4efe-4658-9a53-0cfa7d80e93d" released by "delete_volume" :: held 1.255s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:09 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-97e62246-65ce-4d87-931c-296f07556364 tempest-VolumesSnapshotListTestJSON-1929852474 None] Created reservations ['4665ad43-4685-4154-8944-31f26fc3facf', 'b473b095-57e1-4401-9a9f-82cf4d231536', 'fe1596e6-18ee-486d-9115-a5ce3e874f99', '7c0a653c-1be4-47d8-8685-cbd3f4d63a67'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:38:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-97e62246-65ce-4d87-931c-296f07556364 tempest-VolumesSnapshotListTestJSON-1929852474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-97e62246-65ce-4d87-931c-296f07556364 tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-97e62246-65ce-4d87-931c-296f07556364 tempest-VolumesSnapshotListTestJSON-1929852474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-97e62246-65ce-4d87-931c-296f07556364 tempest-VolumesSnapshotListTestJSON-1929852474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-97e62246-65ce-4d87-931c-296f07556364 tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-97e62246-65ce-4d87-931c-296f07556364 tempest-VolumesSnapshotListTestJSON-1929852474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:09 devstack sudo[97655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:38:09 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:09 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-97e62246-65ce-4d87-931c-296f07556364 tempest-VolumesSnapshotListTestJSON-1929852474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.291s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:09 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-97e62246-65ce-4d87-931c-296f07556364 tempest-VolumesSnapshotListTestJSON-1929852474 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:38:09 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-97e62246-65ce-4d87-931c-296f07556364 tempest-VolumesSnapshotListTestJSON-1929852474 None] Deleted volume successfully.
Nov 07 02:38:09 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-97e62246-65ce-4d87-931c-296f07556364 tempest-VolumesSnapshotListTestJSON-1929852474 None] Lock "cinder-c66c683b-4efe-4658-9a53-0cfa7d80e93d-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:10 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:38:10 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Flow 'volume_create_manager' (f4780307-a0ee-4917-a868-4b871b7931d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:10 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e7aa19-db2e-4e9e-b21a-968d2595a894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e7aa19-db2e-4e9e-b21a-968d2595a894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1297517340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=94bee1e0-90ea-4801-96f2-801feef6febd,host='devstack@QuobyteHD#QuobyteHD',id=9a7725d6-5a39-4fa1-a191-b85575ab5cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73c7e7019264f2e80f42a8ac194baa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:11Z,use_quota=True,user_id='f6a22e3e81624996adc04371bf597874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc63f408-c507-4b24-b8cc-80d6b9cb39b0),volume_type_id=cc63f408-c507-4b24-b8cc-80d6b9cb39b0)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42f5003-c535-41b4-b8cf-227382b6bd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42f5003-c535-41b4-b8cf-227382b6bd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5115f870-ca60-4e16-8617-0dee50c38904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5115f870-ca60-4e16-8617-0dee50c38904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a7725d6-5a39-4fa1-a191-b85575ab5cb5', 'volume_name': 'volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea173099-588b-418a-a38b-65a06b41aa0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea173099-588b-418a-a38b-65a06b41aa0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990070c4-2cbe-498e-8b64-600ce8c968f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:11 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Volume 9a7725d6-5a39-4fa1-a191-b85575ab5cb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5', 'volume_size': 1}
Nov 07 02:38:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=94bee1e0-90ea-4801-96f2-801feef6febd,created_at=2026-11-07T01:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1297517340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=94bee1e0-90ea-4801-96f2-801feef6febd,host='devstack@QuobyteHD#QuobyteHD',id=9a7725d6-5a39-4fa1-a191-b85575ab5cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73c7e7019264f2e80f42a8ac194baa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:11Z,use_quota=True,user_id='f6a22e3e81624996adc04371bf597874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc63f408-c507-4b24-b8cc-80d6b9cb39b0),volume_type_id=cc63f408-c507-4b24-b8cc-80d6b9cb39b0)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:38:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Creating volume 9a7725d6-5a39-4fa1-a191-b85575ab5cb5 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:38:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:38:11 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:38:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:11 devstack sudo[97658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5 1073741824
Nov 07 02:38:11 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:11 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5 1073741824" returned: 0 in 0.685s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:11 devstack sudo[97677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5
Nov 07 02:38:11 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:12 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5" returned: 0 in 0.369s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:38:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990070c4-2cbe-498e-8b64-600ce8c968f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adfc2678-31be-4754-b51b-a4b24f5e4d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:12 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Volume volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5 (9a7725d6-5a39-4fa1-a191-b85575ab5cb5): created successfully
Nov 07 02:38:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adfc2678-31be-4754-b51b-a4b24f5e4d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Flow 'volume_create_manager' (f4780307-a0ee-4917-a868-4b871b7931d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:12 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-6493baea-aecf-43b4-a7b8-a52963a2a4a2 tempest-GroupSnapshotsV319Test-1675761457 None] Created volume successfully.
Nov 07 02:38:13 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c112c55f-537f-4c99-9ee4-c6193f6bc44b tempest-GroupSnapshotsV319Test-1675761457 None] GroupSnapshot e036fda2-0cad-42a2-a6ef-4405f363b6fa: creating.
Nov 07 02:38:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c112c55f-537f-4c99-9ee4-c6193f6bc44b tempest-GroupSnapshotsV319Test-1675761457 None] Group snapshot e036fda2-0cad-42a2-a6ef-4405f363b6fa: creating. {{(pid=87054) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 07 02:38:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c112c55f-537f-4c99-9ee4-c6193f6bc44b tempest-GroupSnapshotsV319Test-1675761457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c112c55f-537f-4c99-9ee4-c6193f6bc44b tempest-GroupSnapshotsV319Test-1675761457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-c112c55f-537f-4c99-9ee4-c6193f6bc44b tempest-GroupSnapshotsV319Test-1675761457 None] Creating offline snapshot fd42f533-3b40-4890-8dfb-d947a414450b of volume 9a7725d6-5a39-4fa1-a191-b85575ab5cb5 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:38:13 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c5d4c5-d109-46c6-955d-6f5fad8a43c8]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c112c55f-537f-4c99-9ee4-c6193f6bc44b tempest-GroupSnapshotsV319Test-1675761457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:14 devstack sudo[97686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5
Nov 07 02:38:14 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:14 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c112c55f-537f-4c99-9ee4-c6193f6bc44b tempest-GroupSnapshotsV319Test-1675761457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5" returned: 0 in 0.663s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c112c55f-537f-4c99-9ee4-c6193f6bc44b tempest-GroupSnapshotsV319Test-1675761457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.fd42f533-3b40-4890-8dfb-d947a414450b 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:14 devstack sudo[97698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.fd42f533-3b40-4890-8dfb-d947a414450b 1G
Nov 07 02:38:14 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:15 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c112c55f-537f-4c99-9ee4-c6193f6bc44b tempest-GroupSnapshotsV319Test-1675761457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.fd42f533-3b40-4890-8dfb-d947a414450b 1G" returned: 0 in 0.642s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c112c55f-537f-4c99-9ee4-c6193f6bc44b tempest-GroupSnapshotsV319Test-1675761457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.fd42f533-3b40-4890-8dfb-d947a414450b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:15 devstack sudo[97703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.fd42f533-3b40-4890-8dfb-d947a414450b
Nov 07 02:38:15 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:15 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c112c55f-537f-4c99-9ee4-c6193f6bc44b tempest-GroupSnapshotsV319Test-1675761457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.fd42f533-3b40-4890-8dfb-d947a414450b" returned: 0 in 0.827s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:15 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-c112c55f-537f-4c99-9ee4-c6193f6bc44b tempest-GroupSnapshotsV319Test-1675761457 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.fd42f533-3b40-4890-8dfb-d947a414450b is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:38:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c112c55f-537f-4c99-9ee4-c6193f6bc44b tempest-GroupSnapshotsV319Test-1675761457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.fd42f533-3b40-4890-8dfb-d947a414450b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:16 devstack sudo[97747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.fd42f533-3b40-4890-8dfb-d947a414450b
Nov 07 02:38:16 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:16 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c112c55f-537f-4c99-9ee4-c6193f6bc44b tempest-GroupSnapshotsV319Test-1675761457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.fd42f533-3b40-4890-8dfb-d947a414450b" returned: 0 in 0.591s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c112c55f-537f-4c99-9ee4-c6193f6bc44b tempest-GroupSnapshotsV319Test-1675761457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:16 devstack sudo[97767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.info
Nov 07 02:38:16 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:17 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c112c55f-537f-4c99-9ee4-c6193f6bc44b tempest-GroupSnapshotsV319Test-1675761457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.info" returned: 0 in 0.508s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:17 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-c112c55f-537f-4c99-9ee4-c6193f6bc44b tempest-GroupSnapshotsV319Test-1675761457 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:38:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c112c55f-537f-4c99-9ee4-c6193f6bc44b tempest-GroupSnapshotsV319Test-1675761457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:17 devstack sudo[97777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.info
Nov 07 02:38:17 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:17 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c112c55f-537f-4c99-9ee4-c6193f6bc44b tempest-GroupSnapshotsV319Test-1675761457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.info" returned: 0 in 0.678s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c112c55f-537f-4c99-9ee4-c6193f6bc44b tempest-GroupSnapshotsV319Test-1675761457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.130s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:18 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c112c55f-537f-4c99-9ee4-c6193f6bc44b tempest-GroupSnapshotsV319Test-1675761457 None] group_snapshot e036fda2-0cad-42a2-a6ef-4405f363b6fa: created successfully
Nov 07 02:38:20 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-10623c64-3a94-4c83-8198-dfb4da80aacd tempest-GroupSnapshotsV319Test-1675761457 None] group_snapshot e036fda2-0cad-42a2-a6ef-4405f363b6fa: deleting
Nov 07 02:38:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-10623c64-3a94-4c83-8198-dfb4da80aacd tempest-GroupSnapshotsV319Test-1675761457 None] group_snapshot e036fda2-0cad-42a2-a6ef-4405f363b6fa: deleting {{(pid=87054) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 07 02:38:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-10623c64-3a94-4c83-8198-dfb4da80aacd tempest-GroupSnapshotsV319Test-1675761457 None] Acquiring lock "cinder-quobyte-9a7725d6-5a39-4fa1-a191-b85575ab5cb5" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-10623c64-3a94-4c83-8198-dfb4da80aacd tempest-GroupSnapshotsV319Test-1675761457 None] Lock "cinder-quobyte-9a7725d6-5a39-4fa1-a191-b85575ab5cb5" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-10623c64-3a94-4c83-8198-dfb4da80aacd tempest-GroupSnapshotsV319Test-1675761457 None] Acquiring lock "cinder-quobyte-fd42f533-3b40-4890-8dfb-d947a414450b" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-10623c64-3a94-4c83-8198-dfb4da80aacd tempest-GroupSnapshotsV319Test-1675761457 None] Lock "cinder-quobyte-fd42f533-3b40-4890-8dfb-d947a414450b" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-10623c64-3a94-4c83-8198-dfb4da80aacd tempest-GroupSnapshotsV319Test-1675761457 None] Deleting offline snapshot fd42f533-3b40-4890-8dfb-d947a414450b of volume 9a7725d6-5a39-4fa1-a191-b85575ab5cb5 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:38:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-10623c64-3a94-4c83-8198-dfb4da80aacd tempest-GroupSnapshotsV319Test-1675761457 None] snapshot_file for this snap is: volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.fd42f533-3b40-4890-8dfb-d947a414450b {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:38:20 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[33664200-6653-4ecf-a539-5c21457fd6de]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-10623c64-3a94-4c83-8198-dfb4da80aacd tempest-GroupSnapshotsV319Test-1675761457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.fd42f533-3b40-4890-8dfb-d947a414450b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:20 devstack sudo[97790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.fd42f533-3b40-4890-8dfb-d947a414450b
Nov 07 02:38:20 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:21 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-10623c64-3a94-4c83-8198-dfb4da80aacd tempest-GroupSnapshotsV319Test-1675761457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.fd42f533-3b40-4890-8dfb-d947a414450b" returned: 0 in 0.674s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:21 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-10623c64-3a94-4c83-8198-dfb4da80aacd tempest-GroupSnapshotsV319Test-1675761457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:38:21 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cce362c-51bf-41ef-b5b9-0491acf2789c]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-10623c64-3a94-4c83-8198-dfb4da80aacd tempest-GroupSnapshotsV319Test-1675761457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:21 devstack sudo[97808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5
Nov 07 02:38:21 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:21 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-10623c64-3a94-4c83-8198-dfb4da80aacd tempest-GroupSnapshotsV319Test-1675761457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5" returned: 0 in 0.571s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-10623c64-3a94-4c83-8198-dfb4da80aacd tempest-GroupSnapshotsV319Test-1675761457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.fd42f533-3b40-4890-8dfb-d947a414450b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:21 devstack sudo[97825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.fd42f533-3b40-4890-8dfb-d947a414450b
Nov 07 02:38:21 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:22 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-10623c64-3a94-4c83-8198-dfb4da80aacd tempest-GroupSnapshotsV319Test-1675761457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.fd42f533-3b40-4890-8dfb-d947a414450b" returned: 0 in 0.432s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-10623c64-3a94-4c83-8198-dfb4da80aacd tempest-GroupSnapshotsV319Test-1675761457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.fd42f533-3b40-4890-8dfb-d947a414450b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:22 devstack sudo[97831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.fd42f533-3b40-4890-8dfb-d947a414450b
Nov 07 02:38:22 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:22 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-10623c64-3a94-4c83-8198-dfb4da80aacd tempest-GroupSnapshotsV319Test-1675761457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5.fd42f533-3b40-4890-8dfb-d947a414450b" returned: 0 in 0.310s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:22 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-10623c64-3a94-4c83-8198-dfb4da80aacd tempest-GroupSnapshotsV319Test-1675761457 None] Lock "cinder-quobyte-fd42f533-3b40-4890-8dfb-d947a414450b" released by "_delete_snapshot" :: held 2.239s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:22 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-10623c64-3a94-4c83-8198-dfb4da80aacd tempest-GroupSnapshotsV319Test-1675761457 None] Lock "cinder-quobyte-9a7725d6-5a39-4fa1-a191-b85575ab5cb5" released by "delete_snapshot" :: held 2.281s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:22 devstack cinder-volume[87054]: WARNING cinder.quota [None req-10623c64-3a94-4c83-8198-dfb4da80aacd tempest-GroupSnapshotsV319Test-1675761457 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-204730844 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-204730844, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:38:22 devstack cinder-volume[87054]: WARNING cinder.quota [None req-10623c64-3a94-4c83-8198-dfb4da80aacd tempest-GroupSnapshotsV319Test-1675761457 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-204730844 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-204730844, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:38:22 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-10623c64-3a94-4c83-8198-dfb4da80aacd tempest-GroupSnapshotsV319Test-1675761457 None] Created reservations ['22128890-a724-4891-89b9-deed6e052bb2', 'a58429ef-197e-46e6-9f09-bef663cbe5cf', 'f5d3b678-e7aa-4c95-94c2-3302c4bc0a28', '4632350e-a302-46f2-91e0-d3e495ae836f'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:38:23 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-10623c64-3a94-4c83-8198-dfb4da80aacd tempest-GroupSnapshotsV319Test-1675761457 None] group_snapshot e036fda2-0cad-42a2-a6ef-4405f363b6fa: deleted successfully
Nov 07 02:38:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e1b397d1-d4a3-4247-9795-20e6770eef25 tempest-GroupSnapshotsV319Test-1675761457 None] Acquiring lock "cinder-quobyte-9a7725d6-5a39-4fa1-a191-b85575ab5cb5" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e1b397d1-d4a3-4247-9795-20e6770eef25 tempest-GroupSnapshotsV319Test-1675761457 None] Lock "cinder-quobyte-9a7725d6-5a39-4fa1-a191-b85575ab5cb5" acquired by "delete_volume" :: waited 0.026s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:24 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[b044ba14-892b-4add-a833-e54a7f8a2fbe]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e1b397d1-d4a3-4247-9795-20e6770eef25 tempest-GroupSnapshotsV319Test-1675761457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:24 devstack sudo[97836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5
Nov 07 02:38:24 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:24 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e1b397d1-d4a3-4247-9795-20e6770eef25 tempest-GroupSnapshotsV319Test-1675761457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5" returned: 0 in 0.474s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e1b397d1-d4a3-4247-9795-20e6770eef25 tempest-GroupSnapshotsV319Test-1675761457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:24 devstack sudo[97841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5
Nov 07 02:38:24 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:25 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e1b397d1-d4a3-4247-9795-20e6770eef25 tempest-GroupSnapshotsV319Test-1675761457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9a7725d6-5a39-4fa1-a191-b85575ab5cb5" returned: 0 in 0.290s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e1b397d1-d4a3-4247-9795-20e6770eef25 tempest-GroupSnapshotsV319Test-1675761457 None] Lock "cinder-quobyte-9a7725d6-5a39-4fa1-a191-b85575ab5cb5" released by "delete_volume" :: held 0.865s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:25 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-e1b397d1-d4a3-4247-9795-20e6770eef25 tempest-GroupSnapshotsV319Test-1675761457 None] Created reservations ['15b16c3a-d283-4750-98c5-7a36ff9f3a67'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:38:25 devstack cinder-volume[87054]: WARNING cinder.quota [None req-e1b397d1-d4a3-4247-9795-20e6770eef25 tempest-GroupSnapshotsV319Test-1675761457 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-204730844 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-204730844, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:38:25 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-e1b397d1-d4a3-4247-9795-20e6770eef25 tempest-GroupSnapshotsV319Test-1675761457 None] Created reservations ['8a3e5bcf-ab84-4d5d-b542-c2bf161ccd99', 'd0d3085d-838d-419c-8286-240d65f2318d', 'fa491aa8-1efd-4d5f-ab50-c7e286efd40d', '9b68d008-83af-487c-b467-5d069dde8d72'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:38:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e1b397d1-d4a3-4247-9795-20e6770eef25 tempest-GroupSnapshotsV319Test-1675761457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e1b397d1-d4a3-4247-9795-20e6770eef25 tempest-GroupSnapshotsV319Test-1675761457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e1b397d1-d4a3-4247-9795-20e6770eef25 tempest-GroupSnapshotsV319Test-1675761457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e1b397d1-d4a3-4247-9795-20e6770eef25 tempest-GroupSnapshotsV319Test-1675761457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e1b397d1-d4a3-4247-9795-20e6770eef25 tempest-GroupSnapshotsV319Test-1675761457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e1b397d1-d4a3-4247-9795-20e6770eef25 tempest-GroupSnapshotsV319Test-1675761457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:25 devstack sudo[97844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:38:25 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:25 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e1b397d1-d4a3-4247-9795-20e6770eef25 tempest-GroupSnapshotsV319Test-1675761457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.440s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:25 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-e1b397d1-d4a3-4247-9795-20e6770eef25 tempest-GroupSnapshotsV319Test-1675761457 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:38:25 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-e1b397d1-d4a3-4247-9795-20e6770eef25 tempest-GroupSnapshotsV319Test-1675761457 None] Delete group completed successfully.
Nov 07 02:38:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6c14c07d-931a-4d74-b863-e45c8d48907b tempest-VolumesNegativeTest-1184575541 None] Acquiring lock "cinder-891001db-3c5f-4256-a517-ebf92996368c-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6c14c07d-931a-4d74-b863-e45c8d48907b tempest-VolumesNegativeTest-1184575541 None] Lock "cinder-891001db-3c5f-4256-a517-ebf92996368c-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:33 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:DELETE=10,cinder:SELECT=119,cinder:INSERT=39,cinder:UPDATE=125 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:38:33 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:UPDATE=128,cinder:SELECT=126,cinder:INSERT=35,cinder:DELETE=7 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:38:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6c14c07d-931a-4d74-b863-e45c8d48907b tempest-VolumesNegativeTest-1184575541 None] Acquiring lock "cinder-quobyte-891001db-3c5f-4256-a517-ebf92996368c" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6c14c07d-931a-4d74-b863-e45c8d48907b tempest-VolumesNegativeTest-1184575541 None] Lock "cinder-quobyte-891001db-3c5f-4256-a517-ebf92996368c" acquired by "delete_volume" :: waited 0.042s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:33 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[24924960-f718-4a04-a4d9-9a485b8e6306]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6c14c07d-931a-4d74-b863-e45c8d48907b tempest-VolumesNegativeTest-1184575541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-891001db-3c5f-4256-a517-ebf92996368c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:34 devstack sudo[97877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-891001db-3c5f-4256-a517-ebf92996368c
Nov 07 02:38:34 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:34 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6c14c07d-931a-4d74-b863-e45c8d48907b tempest-VolumesNegativeTest-1184575541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-891001db-3c5f-4256-a517-ebf92996368c" returned: 0 in 0.504s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6c14c07d-931a-4d74-b863-e45c8d48907b tempest-VolumesNegativeTest-1184575541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-891001db-3c5f-4256-a517-ebf92996368c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:34 devstack sudo[97882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-891001db-3c5f-4256-a517-ebf92996368c
Nov 07 02:38:34 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:34 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6c14c07d-931a-4d74-b863-e45c8d48907b tempest-VolumesNegativeTest-1184575541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-891001db-3c5f-4256-a517-ebf92996368c" returned: 0 in 0.323s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6c14c07d-931a-4d74-b863-e45c8d48907b tempest-VolumesNegativeTest-1184575541 None] Lock "cinder-quobyte-891001db-3c5f-4256-a517-ebf92996368c" released by "delete_volume" :: held 0.918s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:34 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-6c14c07d-931a-4d74-b863-e45c8d48907b tempest-VolumesNegativeTest-1184575541 None] Created reservations ['ca214ed0-ae15-4e19-ac96-1c142e5f2461', '51208ba4-f188-4017-ad0b-5ad34b05a0cd', 'eda15607-126d-4816-b4b8-1733af0193d8', 'dd8ff48e-8106-45e3-ad1b-46ccba87b47d'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:38:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6c14c07d-931a-4d74-b863-e45c8d48907b tempest-VolumesNegativeTest-1184575541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6c14c07d-931a-4d74-b863-e45c8d48907b tempest-VolumesNegativeTest-1184575541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6c14c07d-931a-4d74-b863-e45c8d48907b tempest-VolumesNegativeTest-1184575541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6c14c07d-931a-4d74-b863-e45c8d48907b tempest-VolumesNegativeTest-1184575541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6c14c07d-931a-4d74-b863-e45c8d48907b tempest-VolumesNegativeTest-1184575541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6c14c07d-931a-4d74-b863-e45c8d48907b tempest-VolumesNegativeTest-1184575541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:35 devstack sudo[97885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:38:35 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:35 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6c14c07d-931a-4d74-b863-e45c8d48907b tempest-VolumesNegativeTest-1184575541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.357s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:35 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6c14c07d-931a-4d74-b863-e45c8d48907b tempest-VolumesNegativeTest-1184575541 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:38:35 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-6c14c07d-931a-4d74-b863-e45c8d48907b tempest-VolumesNegativeTest-1184575541 None] Deleted volume successfully.
Nov 07 02:38:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6c14c07d-931a-4d74-b863-e45c8d48907b tempest-VolumesNegativeTest-1184575541 None] Lock "cinder-891001db-3c5f-4256-a517-ebf92996368c-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:43 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:38:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Flow 'volume_create_manager' (4f4fc7fe-ae1a-427b-847a-d8a107f3b6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (470134a5-e8bf-4b43-827f-a2a9dc03b3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (470134a5-e8bf-4b43-827f-a2a9dc03b3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1374421374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b3c77ac-2832-418c-942a-8e19e8a24ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd067bbf9244510804b71d6bf8f4876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:43Z,use_quota=True,user_id='30bedfed77cd4f608da655dcb481bd27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8701486-9dc7-4ab5-a537-e7d3225a45f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8701486-9dc7-4ab5-a537-e7d3225a45f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967c258c-b3b5-4ce5-85cd-849370e97cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967c258c-b3b5-4ce5-85cd-849370e97cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b3c77ac-2832-418c-942a-8e19e8a24ff0', 'volume_name': 'volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0', 'volume_size': 2}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e757a9-5411-4344-98dd-18995e8148bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e757a9-5411-4344-98dd-18995e8148bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637267a0-5ab0-4656-99f7-5dda08c75579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:43 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Volume 8b3c77ac-2832-418c-942a-8e19e8a24ff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0', 'volume_size': 2}
Nov 07 02:38:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1374421374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b3c77ac-2832-418c-942a-8e19e8a24ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd067bbf9244510804b71d6bf8f4876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:43Z,use_quota=True,user_id='30bedfed77cd4f608da655dcb481bd27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:38:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Creating volume 8b3c77ac-2832-418c-942a-8e19e8a24ff0 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:38:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:38:43 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:38:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0 2147483648 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:43 devstack sudo[97894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0 2147483648
Nov 07 02:38:43 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:44 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0 2147483648" returned: 0 in 0.725s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:44 devstack sudo[97900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0
Nov 07 02:38:44 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:44 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0" returned: 0 in 0.292s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:38:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637267a0-5ab0-4656-99f7-5dda08c75579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0', 'volume_size': 2}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd1f571-c8b1-4ca7-bac4-c7a247f70da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:44 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Volume volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0 (8b3c77ac-2832-418c-942a-8e19e8a24ff0): created successfully
Nov 07 02:38:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd1f571-c8b1-4ca7-bac4-c7a247f70da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Flow 'volume_create_manager' (4f4fc7fe-ae1a-427b-847a-d8a107f3b6d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:44 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-7c9b5fb3-ffe7-49c9-9e21-408d35bb5949 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Created volume successfully.
Nov 07 02:38:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-414aaa88-3f5e-4830-8ceb-deda01a20ef2 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-414aaa88-3f5e-4830-8ceb-deda01a20ef2 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-414aaa88-3f5e-4830-8ceb-deda01a20ef2 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Creating offline snapshot d054111d-fe3b-4660-8bad-baf20afb9dec of volume 8b3c77ac-2832-418c-942a-8e19e8a24ff0 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:38:45 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f36023-ecf6-46fb-ab1c-208e96e769a0]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-414aaa88-3f5e-4830-8ceb-deda01a20ef2 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:46 devstack sudo[97906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0
Nov 07 02:38:46 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:46 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-414aaa88-3f5e-4830-8ceb-deda01a20ef2 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0" returned: 0 in 0.530s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-414aaa88-3f5e-4830-8ceb-deda01a20ef2 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.d054111d-fe3b-4660-8bad-baf20afb9dec 2G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:46 devstack sudo[97911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.d054111d-fe3b-4660-8bad-baf20afb9dec 2G
Nov 07 02:38:46 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:47 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-414aaa88-3f5e-4830-8ceb-deda01a20ef2 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.d054111d-fe3b-4660-8bad-baf20afb9dec 2G" returned: 0 in 0.661s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-414aaa88-3f5e-4830-8ceb-deda01a20ef2 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.d054111d-fe3b-4660-8bad-baf20afb9dec {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:47 devstack sudo[97918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.d054111d-fe3b-4660-8bad-baf20afb9dec
Nov 07 02:38:47 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:47 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-414aaa88-3f5e-4830-8ceb-deda01a20ef2 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.d054111d-fe3b-4660-8bad-baf20afb9dec" returned: 0 in 0.622s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:47 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-414aaa88-3f5e-4830-8ceb-deda01a20ef2 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.d054111d-fe3b-4660-8bad-baf20afb9dec is being set with open permissions: ugo+rw
Nov 07 02:38:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-414aaa88-3f5e-4830-8ceb-deda01a20ef2 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.d054111d-fe3b-4660-8bad-baf20afb9dec {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:47 devstack sudo[97937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.d054111d-fe3b-4660-8bad-baf20afb9dec
Nov 07 02:38:47 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:48 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-414aaa88-3f5e-4830-8ceb-deda01a20ef2 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.d054111d-fe3b-4660-8bad-baf20afb9dec" returned: 0 in 0.410s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-414aaa88-3f5e-4830-8ceb-deda01a20ef2 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:48 devstack sudo[97945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.info
Nov 07 02:38:48 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:48 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-414aaa88-3f5e-4830-8ceb-deda01a20ef2 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.info" returned: 0 in 0.403s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:48 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-414aaa88-3f5e-4830-8ceb-deda01a20ef2 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.info is being set with open permissions: ugo+rw
Nov 07 02:38:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-414aaa88-3f5e-4830-8ceb-deda01a20ef2 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:48 devstack sudo[97948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.info
Nov 07 02:38:48 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:49 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-414aaa88-3f5e-4830-8ceb-deda01a20ef2 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.info" returned: 0 in 0.373s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-414aaa88-3f5e-4830-8ceb-deda01a20ef2 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.166s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:49 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-414aaa88-3f5e-4830-8ceb-deda01a20ef2 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Create snapshot completed successfully
Nov 07 02:38:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a1ea0a59-9ce6-45a5-9908-918bda4c2d23 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Acquiring lock "cinder-d054111d-fe3b-4660-8bad-baf20afb9dec-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a1ea0a59-9ce6-45a5-9908-918bda4c2d23 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Lock "cinder-d054111d-fe3b-4660-8bad-baf20afb9dec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a1ea0a59-9ce6-45a5-9908-918bda4c2d23 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Acquiring lock "cinder-quobyte-8b3c77ac-2832-418c-942a-8e19e8a24ff0" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a1ea0a59-9ce6-45a5-9908-918bda4c2d23 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Lock "cinder-quobyte-8b3c77ac-2832-418c-942a-8e19e8a24ff0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a1ea0a59-9ce6-45a5-9908-918bda4c2d23 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Acquiring lock "cinder-quobyte-d054111d-fe3b-4660-8bad-baf20afb9dec" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a1ea0a59-9ce6-45a5-9908-918bda4c2d23 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Lock "cinder-quobyte-d054111d-fe3b-4660-8bad-baf20afb9dec" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:50 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-a1ea0a59-9ce6-45a5-9908-918bda4c2d23 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Deleting offline snapshot d054111d-fe3b-4660-8bad-baf20afb9dec of volume 8b3c77ac-2832-418c-942a-8e19e8a24ff0 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:38:50 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-a1ea0a59-9ce6-45a5-9908-918bda4c2d23 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] snapshot_file for this snap is: volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.d054111d-fe3b-4660-8bad-baf20afb9dec {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:38:50 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[4734b73e-43c3-4225-813e-6c3ff496527c]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a1ea0a59-9ce6-45a5-9908-918bda4c2d23 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.d054111d-fe3b-4660-8bad-baf20afb9dec {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:50 devstack sudo[97968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.d054111d-fe3b-4660-8bad-baf20afb9dec
Nov 07 02:38:50 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:51 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a1ea0a59-9ce6-45a5-9908-918bda4c2d23 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.d054111d-fe3b-4660-8bad-baf20afb9dec" returned: 0 in 0.523s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:51 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-a1ea0a59-9ce6-45a5-9908-918bda4c2d23 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:38:51 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5731bd9-a91d-42e1-a2d8-033ea236a733]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a1ea0a59-9ce6-45a5-9908-918bda4c2d23 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:51 devstack sudo[97974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0
Nov 07 02:38:51 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:51 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a1ea0a59-9ce6-45a5-9908-918bda4c2d23 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0" returned: 0 in 0.528s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a1ea0a59-9ce6-45a5-9908-918bda4c2d23 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.d054111d-fe3b-4660-8bad-baf20afb9dec {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:51 devstack sudo[97988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.d054111d-fe3b-4660-8bad-baf20afb9dec
Nov 07 02:38:51 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:52 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a1ea0a59-9ce6-45a5-9908-918bda4c2d23 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.d054111d-fe3b-4660-8bad-baf20afb9dec" returned: 0 in 0.824s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a1ea0a59-9ce6-45a5-9908-918bda4c2d23 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.d054111d-fe3b-4660-8bad-baf20afb9dec {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:52 devstack sudo[98039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.d054111d-fe3b-4660-8bad-baf20afb9dec
Nov 07 02:38:52 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:52 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a1ea0a59-9ce6-45a5-9908-918bda4c2d23 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0.d054111d-fe3b-4660-8bad-baf20afb9dec" returned: 0 in 0.465s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a1ea0a59-9ce6-45a5-9908-918bda4c2d23 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Lock "cinder-quobyte-d054111d-fe3b-4660-8bad-baf20afb9dec" released by "_delete_snapshot" :: held 2.542s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a1ea0a59-9ce6-45a5-9908-918bda4c2d23 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Lock "cinder-quobyte-8b3c77ac-2832-418c-942a-8e19e8a24ff0" released by "delete_snapshot" :: held 2.582s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:53 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-a1ea0a59-9ce6-45a5-9908-918bda4c2d23 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Created reservations ['72529b74-bd66-453c-bc0b-2f6ba58888d2', '8a6fe572-d2c6-4dc6-a72c-8906b185fe3e', 'a8c0110b-5a49-4f1a-b119-04081c93e93a', '104f6a77-c9e4-4f94-b328-65bf3d340d87'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:38:53 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-a1ea0a59-9ce6-45a5-9908-918bda4c2d23 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Delete snapshot completed successfully.
Nov 07 02:38:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a1ea0a59-9ce6-45a5-9908-918bda4c2d23 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Lock "cinder-d054111d-fe3b-4660-8bad-baf20afb9dec-delete_snapshot" released by "delete_snapshot" :: held 2.858s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ff83b655-c519-4586-836b-bb647b82d4d0 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Acquiring lock "cinder-8b3c77ac-2832-418c-942a-8e19e8a24ff0-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ff83b655-c519-4586-836b-bb647b82d4d0 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Lock "cinder-8b3c77ac-2832-418c-942a-8e19e8a24ff0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:54 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ff83b655-c519-4586-836b-bb647b82d4d0 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Acquiring lock "cinder-quobyte-8b3c77ac-2832-418c-942a-8e19e8a24ff0" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:38:54 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ff83b655-c519-4586-836b-bb647b82d4d0 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Lock "cinder-quobyte-8b3c77ac-2832-418c-942a-8e19e8a24ff0" acquired by "delete_volume" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:38:54 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c6f5f7-8e55-45bb-8e1b-7e5406c0be98]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:38:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff83b655-c519-4586-836b-bb647b82d4d0 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:54 devstack sudo[98059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0
Nov 07 02:38:54 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:55 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff83b655-c519-4586-836b-bb647b82d4d0 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0" returned: 0 in 1.306s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff83b655-c519-4586-836b-bb647b82d4d0 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:55 devstack sudo[98109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0
Nov 07 02:38:55 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:56 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff83b655-c519-4586-836b-bb647b82d4d0 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8b3c77ac-2832-418c-942a-8e19e8a24ff0" returned: 0 in 1.057s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:56 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ff83b655-c519-4586-836b-bb647b82d4d0 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Lock "cinder-quobyte-8b3c77ac-2832-418c-942a-8e19e8a24ff0" released by "delete_volume" :: held 2.532s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:56 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-ff83b655-c519-4586-836b-bb647b82d4d0 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Created reservations ['9af5860e-8da3-49a5-868d-172b9b5dc89b', '2ca702fd-d47d-4f65-9cbf-e4e0c62b20e1', '22352f85-02a2-470d-94b3-c6175013b949', '16597d7b-40c2-433c-b8a1-e392295537f2'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ff83b655-c519-4586-836b-bb647b82d4d0 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ff83b655-c519-4586-836b-bb647b82d4d0 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ff83b655-c519-4586-836b-bb647b82d4d0 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ff83b655-c519-4586-836b-bb647b82d4d0 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ff83b655-c519-4586-836b-bb647b82d4d0 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff83b655-c519-4586-836b-bb647b82d4d0 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:57 devstack sudo[98165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:38:57 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Flow 'volume_create_manager' (05615882-edd0-45b2-8ff1-73e2f1ab0b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df93eaf-1c72-4dcc-b536-5b6d99cf0ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df93eaf-1c72-4dcc-b536-5b6d99cf0ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-43877339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9633ab7c-c8a1-444c-b7ce-fa85f74823ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05393dda7d414c5194766c52063f4e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:57Z,use_quota=True,user_id='3af174b0cd154dbe8143f630abc31607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6015bdb6-efec-4572-b7fa-05a47e2f0653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6015bdb6-efec-4572-b7fa-05a47e2f0653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d093621-376b-49c1-893f-106402442d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d093621-376b-49c1-893f-106402442d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9633ab7c-c8a1-444c-b7ce-fa85f74823ef', 'volume_name': 'volume-9633ab7c-c8a1-444c-b7ce-fa85f74823ef', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63abc9ad-cabf-4106-adb3-a33ad2280631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63abc9ad-cabf-4106-adb3-a33ad2280631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e746ca57-e29c-4cc9-bde3-15830c045b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:57 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Volume 9633ab7c-c8a1-444c-b7ce-fa85f74823ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9633ab7c-c8a1-444c-b7ce-fa85f74823ef', 'volume_size': 1}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-43877339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9633ab7c-c8a1-444c-b7ce-fa85f74823ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05393dda7d414c5194766c52063f4e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:38:57Z,use_quota=True,user_id='3af174b0cd154dbe8143f630abc31607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Creating volume 9633ab7c-c8a1-444c-b7ce-fa85f74823ef {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:38:57 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:38:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9633ab7c-c8a1-444c-b7ce-fa85f74823ef 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:57 devstack sudo[98169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9633ab7c-c8a1-444c-b7ce-fa85f74823ef 1073741824
Nov 07 02:38:57 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:58 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff83b655-c519-4586-836b-bb647b82d4d0 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.955s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:58 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-ff83b655-c519-4586-836b-bb647b82d4d0 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:38:58 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ff83b655-c519-4586-836b-bb647b82d4d0 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Deleted volume successfully.
Nov 07 02:38:58 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ff83b655-c519-4586-836b-bb647b82d4d0 tempest-VolumesSnapshotNegativeTestJSON-1437701710 None] Lock "cinder-8b3c77ac-2832-418c-942a-8e19e8a24ff0-delete_volume" released by "delete_volume" :: held 4.103s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:38:58 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9633ab7c-c8a1-444c-b7ce-fa85f74823ef 1073741824" returned: 0 in 1.076s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9633ab7c-c8a1-444c-b7ce-fa85f74823ef {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:58 devstack sudo[98175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9633ab7c-c8a1-444c-b7ce-fa85f74823ef
Nov 07 02:38:58 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:38:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:38:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:38:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:38:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:38:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:38:59 devstack sudo[98179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:38:59 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:38:59 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9633ab7c-c8a1-444c-b7ce-fa85f74823ef" returned: 0 in 0.579s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:38:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:38:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e746ca57-e29c-4cc9-bde3-15830c045b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9633ab7c-c8a1-444c-b7ce-fa85f74823ef', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f49d76-5c50-4b24-89fa-6078e2400a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:38:59 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Volume volume-9633ab7c-c8a1-444c-b7ce-fa85f74823ef (9633ab7c-c8a1-444c-b7ce-fa85f74823ef): created successfully
Nov 07 02:38:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f49d76-5c50-4b24-89fa-6078e2400a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:38:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Flow 'volume_create_manager' (05615882-edd0-45b2-8ff1-73e2f1ab0b76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:38:59 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-e098066f-9272-4178-8ab9-13f33f8b4134 tempest-VolumeQuotasAdminTestJSON-920505085 None] Created volume successfully.
Nov 07 02:38:59 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root
Nov 07 02:38:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.563s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:38:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:38:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:38:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 28 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:38:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>, <Thread(fd_logger, started daemon 125443282798592)>, <Thread(privsep_reader, started daemon 125443284556288)>, <Thread(tpool_thread_0, started daemon 125443276445376)>, <Thread(tpool_thread_1, started daemon 125443268036288)>, <Thread(tpool_thread_2, started daemon 125443259627200)>, <Thread(tpool_thread_3, started daemon 125443251218112)>, <Thread(tpool_thread_4, started daemon 125443242809024)>, <Thread(tpool_thread_5, started daemon 125443234399936)>, <Thread(tpool_thread_6, started daemon 125443225990848)>, <Thread(tpool_thread_7, started daemon 125443217581760)>, <Thread(tpool_thread_8, started daemon 125443209172672)>, <Thread(tpool_thread_9, started daemon 125443200763584)>, <Thread(tpool_thread_10, started daemon 125443192354496)>, <Thread(tpool_thread_11, started daemon 125443183945408)>, <Thread(tpool_thread_12, started daemon 125443175536320)>, <Thread(tpool_thread_13, started daemon 125443167127232)>, <Thread(tpool_thread_14, started daemon 125443158718144)>, <Thread(tpool_thread_15, started daemon 125443150309056)>, <Thread(tpool_thread_16, started daemon 125443141899968)>, <Thread(tpool_thread_17, started daemon 125443133490880)>, <Thread(tpool_thread_18, started daemon 125443125081792)>, <Thread(tpool_thread_19, started daemon 125443116672704)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:39:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-713fc477-a4c1-4540-add1-707faa7cef2e tempest-VolumeQuotasAdminTestJSON-920505085 None] Acquiring lock "cinder-9633ab7c-c8a1-444c-b7ce-fa85f74823ef-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-713fc477-a4c1-4540-add1-707faa7cef2e tempest-VolumeQuotasAdminTestJSON-920505085 None] Lock "cinder-9633ab7c-c8a1-444c-b7ce-fa85f74823ef-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-713fc477-a4c1-4540-add1-707faa7cef2e tempest-VolumeQuotasAdminTestJSON-920505085 None] Acquiring lock "cinder-quobyte-9633ab7c-c8a1-444c-b7ce-fa85f74823ef" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-713fc477-a4c1-4540-add1-707faa7cef2e tempest-VolumeQuotasAdminTestJSON-920505085 None] Lock "cinder-quobyte-9633ab7c-c8a1-444c-b7ce-fa85f74823ef" acquired by "delete_volume" :: waited 0.027s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:01 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b84c345-c27c-4409-8b75-16788c0f9342]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-713fc477-a4c1-4540-add1-707faa7cef2e tempest-VolumeQuotasAdminTestJSON-920505085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9633ab7c-c8a1-444c-b7ce-fa85f74823ef {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:01 devstack sudo[98184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9633ab7c-c8a1-444c-b7ce-fa85f74823ef
Nov 07 02:39:01 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:02 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-713fc477-a4c1-4540-add1-707faa7cef2e tempest-VolumeQuotasAdminTestJSON-920505085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9633ab7c-c8a1-444c-b7ce-fa85f74823ef" returned: 0 in 0.942s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-713fc477-a4c1-4540-add1-707faa7cef2e tempest-VolumeQuotasAdminTestJSON-920505085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9633ab7c-c8a1-444c-b7ce-fa85f74823ef {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:02 devstack sudo[98190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9633ab7c-c8a1-444c-b7ce-fa85f74823ef
Nov 07 02:39:02 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:02 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-713fc477-a4c1-4540-add1-707faa7cef2e tempest-VolumeQuotasAdminTestJSON-920505085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9633ab7c-c8a1-444c-b7ce-fa85f74823ef" returned: 0 in 0.467s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-713fc477-a4c1-4540-add1-707faa7cef2e tempest-VolumeQuotasAdminTestJSON-920505085 None] Lock "cinder-quobyte-9633ab7c-c8a1-444c-b7ce-fa85f74823ef" released by "delete_volume" :: held 1.525s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:02 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-713fc477-a4c1-4540-add1-707faa7cef2e tempest-VolumeQuotasAdminTestJSON-920505085 None] Created reservations ['cb6fae41-d1ad-4dd3-931d-0e9fbed2af1d', 'f26029ad-f97b-4ed9-abbc-5e21d31c4afd', 'efe78683-e712-46c7-ac61-98523f775015', 'a21aaf8c-aa03-440c-821d-9b3e0c17de3a'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:39:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-713fc477-a4c1-4540-add1-707faa7cef2e tempest-VolumeQuotasAdminTestJSON-920505085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-713fc477-a4c1-4540-add1-707faa7cef2e tempest-VolumeQuotasAdminTestJSON-920505085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:02 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-713fc477-a4c1-4540-add1-707faa7cef2e tempest-VolumeQuotasAdminTestJSON-920505085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-713fc477-a4c1-4540-add1-707faa7cef2e tempest-VolumeQuotasAdminTestJSON-920505085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-713fc477-a4c1-4540-add1-707faa7cef2e tempest-VolumeQuotasAdminTestJSON-920505085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-713fc477-a4c1-4540-add1-707faa7cef2e tempest-VolumeQuotasAdminTestJSON-920505085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:03 devstack sudo[98194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:39:03 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:03 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-713fc477-a4c1-4540-add1-707faa7cef2e tempest-VolumeQuotasAdminTestJSON-920505085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.421s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:03 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-713fc477-a4c1-4540-add1-707faa7cef2e tempest-VolumeQuotasAdminTestJSON-920505085 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:39:03 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-713fc477-a4c1-4540-add1-707faa7cef2e tempest-VolumeQuotasAdminTestJSON-920505085 None] Deleted volume successfully.
Nov 07 02:39:03 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-713fc477-a4c1-4540-add1-707faa7cef2e tempest-VolumeQuotasAdminTestJSON-920505085 None] Lock "cinder-9633ab7c-c8a1-444c-b7ce-fa85f74823ef-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:04 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:39:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Flow 'volume_create_manager' (27de8a56-5247-4802-8357-dc5d9b51e366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0aca13-6049-45b6-b571-b7e71c4179db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0aca13-6049-45b6-b571-b7e71c4179db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1257968159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05393dda7d414c5194766c52063f4e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:05Z,use_quota=True,user_id='3af174b0cd154dbe8143f630abc31607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d77b32-8789-458f-ba06-0997bd470f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d77b32-8789-458f-ba06-0997bd470f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c71146-e12f-40e8-aeab-ae5cde13c2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c71146-e12f-40e8-aeab-ae5cde13c2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d', 'volume_name': 'volume-7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca15c8f3-350d-404d-9f81-97f8b82c0171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca15c8f3-350d-404d-9f81-97f8b82c0171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0154c6a8-b924-44af-8edf-2876dad274f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:04 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Volume 7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d', 'volume_size': 1}
Nov 07 02:39:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1257968159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05393dda7d414c5194766c52063f4e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:05Z,use_quota=True,user_id='3af174b0cd154dbe8143f630abc31607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:39:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Creating volume 7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:39:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:39:04 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:39:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:04 devstack sudo[98198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d 1073741824
Nov 07 02:39:04 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:05 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d 1073741824" returned: 0 in 0.821s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:05 devstack sudo[98204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d
Nov 07 02:39:05 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:05 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d" returned: 0 in 0.337s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:39:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0154c6a8-b924-44af-8edf-2876dad274f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6a1ad4-6c58-46b8-9d50-a8a981936df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:06 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Volume volume-7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d (7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d): created successfully
Nov 07 02:39:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6a1ad4-6c58-46b8-9d50-a8a981936df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Flow 'volume_create_manager' (27de8a56-5247-4802-8357-dc5d9b51e366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:06 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-eda77901-a7f1-44ab-90ff-fc1d2dacc560 tempest-VolumeQuotasAdminTestJSON-920505085 None] Created volume successfully.
Nov 07 02:39:07 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-9b3a7ef0-e425-4bbd-9679-1f1a8bd87523 tempest-VolumeQuotasAdminTestJSON-112302339 None] Transfer volume completed successfully.
Nov 07 02:39:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-779e22a1-08e3-4a95-b040-4854bb5a0d9b tempest-VolumeQuotasAdminTestJSON-265354445 None] Acquiring lock "cinder-7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-779e22a1-08e3-4a95-b040-4854bb5a0d9b tempest-VolumeQuotasAdminTestJSON-265354445 None] Lock "cinder-7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-779e22a1-08e3-4a95-b040-4854bb5a0d9b tempest-VolumeQuotasAdminTestJSON-265354445 None] Acquiring lock "cinder-quobyte-7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-779e22a1-08e3-4a95-b040-4854bb5a0d9b tempest-VolumeQuotasAdminTestJSON-265354445 None] Lock "cinder-quobyte-7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d" acquired by "delete_volume" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:08 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0373e2-d0fb-4525-aee7-c7ab54519600]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-779e22a1-08e3-4a95-b040-4854bb5a0d9b tempest-VolumeQuotasAdminTestJSON-265354445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:08 devstack sudo[98243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d
Nov 07 02:39:08 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:08 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-779e22a1-08e3-4a95-b040-4854bb5a0d9b tempest-VolumeQuotasAdminTestJSON-265354445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d" returned: 0 in 0.383s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-779e22a1-08e3-4a95-b040-4854bb5a0d9b tempest-VolumeQuotasAdminTestJSON-265354445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:08 devstack sudo[98248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d
Nov 07 02:39:08 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:09 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-779e22a1-08e3-4a95-b040-4854bb5a0d9b tempest-VolumeQuotasAdminTestJSON-265354445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d" returned: 0 in 0.302s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:09 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-779e22a1-08e3-4a95-b040-4854bb5a0d9b tempest-VolumeQuotasAdminTestJSON-265354445 None] Lock "cinder-quobyte-7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d" released by "delete_volume" :: held 0.763s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:09 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-779e22a1-08e3-4a95-b040-4854bb5a0d9b tempest-VolumeQuotasAdminTestJSON-265354445 None] Created reservations ['5dadd17d-3bfc-440a-ae7d-a578d523fbeb', '947875eb-a28d-454f-8c0b-13f8cef1f1ce', '735310a2-0eaa-46f0-89bd-bec3295d0df0', 'df005316-9712-438a-91f3-38279d465ed0'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:39:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-779e22a1-08e3-4a95-b040-4854bb5a0d9b tempest-VolumeQuotasAdminTestJSON-265354445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-779e22a1-08e3-4a95-b040-4854bb5a0d9b tempest-VolumeQuotasAdminTestJSON-265354445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-779e22a1-08e3-4a95-b040-4854bb5a0d9b tempest-VolumeQuotasAdminTestJSON-265354445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-779e22a1-08e3-4a95-b040-4854bb5a0d9b tempest-VolumeQuotasAdminTestJSON-265354445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-779e22a1-08e3-4a95-b040-4854bb5a0d9b tempest-VolumeQuotasAdminTestJSON-265354445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-779e22a1-08e3-4a95-b040-4854bb5a0d9b tempest-VolumeQuotasAdminTestJSON-265354445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:09 devstack sudo[98251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:39:09 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:09 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-779e22a1-08e3-4a95-b040-4854bb5a0d9b tempest-VolumeQuotasAdminTestJSON-265354445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.419s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:09 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-779e22a1-08e3-4a95-b040-4854bb5a0d9b tempest-VolumeQuotasAdminTestJSON-265354445 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:39:09 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-779e22a1-08e3-4a95-b040-4854bb5a0d9b tempest-VolumeQuotasAdminTestJSON-265354445 None] Deleted volume successfully.
Nov 07 02:39:09 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-779e22a1-08e3-4a95-b040-4854bb5a0d9b tempest-VolumeQuotasAdminTestJSON-265354445 None] Lock "cinder-7a56d1db-32c0-4f5b-bf1c-8cf151b7d64d-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:19 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=35,cinder:INSERT=11,cinder:UPDATE=39,cinder:DELETE=2 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:39:19 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=35,cinder:INSERT=13,cinder:UPDATE=56,cinder:DELETE=6 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Flow 'volume_create_manager' (c40e3529-eaad-4eed-8a2b-744344cb7084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cb874c4-b0d0-4e66-8593-db84689743f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cb874c4-b0d0-4e66-8593-db84689743f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1703924972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7be5c17daf3459a9fd7e8c35dab76a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:20Z,use_quota=True,user_id='145be3ecf2874d55916d564de13c32e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b09abb-1369-450c-b3c2-56d94d52d1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b09abb-1369-450c-b3c2-56d94d52d1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2625645d-0127-4a85-8f34-def8ec77835d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2625645d-0127-4a85-8f34-def8ec77835d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1', 'volume_name': 'volume-2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2e395d-4db7-4fad-812f-788ecab0149b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2e395d-4db7-4fad-812f-788ecab0149b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb3d02d-c459-4afc-b268-e8c762539114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:20 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Volume 2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1', 'volume_size': 1}
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1703924972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7be5c17daf3459a9fd7e8c35dab76a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:20Z,use_quota=True,user_id='145be3ecf2874d55916d564de13c32e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Creating volume 2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:39:20 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:20 devstack sudo[98291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1 1073741824
Nov 07 02:39:20 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:20 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1 1073741824" returned: 0 in 0.537s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:21 devstack sudo[98297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1
Nov 07 02:39:21 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:21 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1" returned: 0 in 0.276s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:21 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:39:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:21 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb3d02d-c459-4afc-b268-e8c762539114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:21 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c5e582-334f-47f8-b4dd-646969af2293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:21 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Volume volume-2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1 (2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1): created successfully
Nov 07 02:39:21 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c5e582-334f-47f8-b4dd-646969af2293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:21 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Flow 'volume_create_manager' (c40e3529-eaad-4eed-8a2b-744344cb7084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:21 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-638f8eff-2253-4338-948f-3b18f28ed86c tempest-AttachVolumeTestJSON-63735962 None] Created volume successfully.
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-3d7928d7-a641-4c1f-a634-27278a37df4e req-aa3692c2-8117-4392-9995-04880a54eb6a tempest-AttachVolumeTestJSON-63735962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-3d7928d7-a641-4c1f-a634-27278a37df4e req-aa3692c2-8117-4392-9995-04880a54eb6a tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-3d7928d7-a641-4c1f-a634-27278a37df4e req-aa3692c2-8117-4392-9995-04880a54eb6a tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Flow 'volume_create_manager' (ca36007d-4f61-49dc-938f-6d2e31ca7eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af484dd8-4c67-4516-8b63-b54a9fe14355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af484dd8-4c67-4516-8b63-b54a9fe14355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-271252618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb26835a-ee85-4460-8e0d-9b94037a34f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2454ef4d237942a0820201bc4b6efd3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:24Z,use_quota=True,user_id='57757eae2ffb4e32a6597546d6968d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e706c75-85db-4087-be4a-ac694eb2c646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e706c75-85db-4087-be4a-ac694eb2c646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e3052a-d3c8-4ef4-901d-e1b665dcc95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e3052a-d3c8-4ef4-901d-e1b665dcc95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb26835a-ee85-4460-8e0d-9b94037a34f6', 'volume_name': 'volume-fb26835a-ee85-4460-8e0d-9b94037a34f6', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6722e793-4433-4aa2-8432-236e1f9bc0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6722e793-4433-4aa2-8432-236e1f9bc0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820d2c87-b0b9-4134-991b-6c05b6a62404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:23 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Volume fb26835a-ee85-4460-8e0d-9b94037a34f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb26835a-ee85-4460-8e0d-9b94037a34f6', 'volume_size': 1}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-271252618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb26835a-ee85-4460-8e0d-9b94037a34f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2454ef4d237942a0820201bc4b6efd3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:24Z,use_quota=True,user_id='57757eae2ffb4e32a6597546d6968d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Creating volume fb26835a-ee85-4460-8e0d-9b94037a34f6 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:39:23 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fb26835a-ee85-4460-8e0d-9b94037a34f6 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-3d7928d7-a641-4c1f-a634-27278a37df4e req-aa3692c2-8117-4392-9995-04880a54eb6a tempest-AttachVolumeTestJSON-63735962 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c', 'name': 'volume-2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f695192-572c-4bc0-a5a9-347a8e7c0d6f', 'enforce_multipath': True} {{(pid=87054) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:39:23 devstack sudo[98313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fb26835a-ee85-4460-8e0d-9b94037a34f6 1073741824
Nov 07 02:39:23 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:24 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-3d7928d7-a641-4c1f-a634-27278a37df4e req-aa3692c2-8117-4392-9995-04880a54eb6a tempest-AttachVolumeTestJSON-63735962 None] attachment_update completed successfully.
Nov 07 02:39:24 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fb26835a-ee85-4460-8e0d-9b94037a34f6 1073741824" returned: 0 in 0.834s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fb26835a-ee85-4460-8e0d-9b94037a34f6 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:24 devstack sudo[98734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fb26835a-ee85-4460-8e0d-9b94037a34f6
Nov 07 02:39:24 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:25 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fb26835a-ee85-4460-8e0d-9b94037a34f6" returned: 0 in 0.529s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:39:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820d2c87-b0b9-4134-991b-6c05b6a62404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb26835a-ee85-4460-8e0d-9b94037a34f6', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380ae1eb-3568-4cd8-9532-0d39e1b73237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:25 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Volume volume-fb26835a-ee85-4460-8e0d-9b94037a34f6 (fb26835a-ee85-4460-8e0d-9b94037a34f6): created successfully
Nov 07 02:39:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380ae1eb-3568-4cd8-9532-0d39e1b73237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Flow 'volume_create_manager' (ca36007d-4f61-49dc-938f-6d2e31ca7eda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:25 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-1ee8d4d5-629d-4160-9d9c-cde4b3d5d593 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Created volume successfully.
Nov 07 02:39:26 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:39:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Flow 'volume_create_manager' (1850570b-7b3c-42a3-9ef7-4eed35b3a903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ffa830f-3fa9-4a0e-a7b6-c19872b8619c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ffa830f-3fa9-4a0e-a7b6-c19872b8619c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-196898854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ceeb69-f788-453e-b6c1-2fb82844d62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7be5c17daf3459a9fd7e8c35dab76a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:27Z,use_quota=True,user_id='145be3ecf2874d55916d564de13c32e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0abea855-a0a0-4a6d-add3-9f96eac71087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0abea855-a0a0-4a6d-add3-9f96eac71087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a71fb9-2e7d-4a7f-838b-2cc614b1eab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a71fb9-2e7d-4a7f-838b-2cc614b1eab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96ceeb69-f788-453e-b6c1-2fb82844d62b', 'volume_name': 'volume-96ceeb69-f788-453e-b6c1-2fb82844d62b', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99dccbca-7c6c-4b30-b64b-02af7af1f757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99dccbca-7c6c-4b30-b64b-02af7af1f757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ffc108f-f2e3-4d2d-8365-bb13aeac4b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:26 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Volume 96ceeb69-f788-453e-b6c1-2fb82844d62b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96ceeb69-f788-453e-b6c1-2fb82844d62b', 'volume_size': 1}
Nov 07 02:39:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-196898854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ceeb69-f788-453e-b6c1-2fb82844d62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7be5c17daf3459a9fd7e8c35dab76a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:27Z,use_quota=True,user_id='145be3ecf2874d55916d564de13c32e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:39:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Creating volume 96ceeb69-f788-453e-b6c1-2fb82844d62b {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:39:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:39:26 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:39:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-96ceeb69-f788-453e-b6c1-2fb82844d62b 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:27 devstack sudo[98747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-96ceeb69-f788-453e-b6c1-2fb82844d62b 1073741824
Nov 07 02:39:27 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-cdc3b198-d137-44b4-8500-026928cf9328 req-a7bc90c4-bd66-4df6-9328-089445c7a208 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:27 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-96ceeb69-f788-453e-b6c1-2fb82844d62b 1073741824" returned: 0 in 0.576s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-96ceeb69-f788-453e-b6c1-2fb82844d62b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:27 devstack sudo[98753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-96ceeb69-f788-453e-b6c1-2fb82844d62b
Nov 07 02:39:27 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:27 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-96ceeb69-f788-453e-b6c1-2fb82844d62b" returned: 0 in 0.361s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:39:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-cdc3b198-d137-44b4-8500-026928cf9328 req-a7bc90c4-bd66-4df6-9328-089445c7a208 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.824s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ffc108f-f2e3-4d2d-8365-bb13aeac4b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96ceeb69-f788-453e-b6c1-2fb82844d62b', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22952a7-6984-4f04-9177-cd8addd77c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-cdc3b198-d137-44b4-8500-026928cf9328 req-a7bc90c4-bd66-4df6-9328-089445c7a208 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:27 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Volume volume-96ceeb69-f788-453e-b6c1-2fb82844d62b (96ceeb69-f788-453e-b6c1-2fb82844d62b): created successfully
Nov 07 02:39:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22952a7-6984-4f04-9177-cd8addd77c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Flow 'volume_create_manager' (1850570b-7b3c-42a3-9ef7-4eed35b3a903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:28 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-5876e862-7a06-4425-8271-5c5dca5c699a tempest-AttachVolumeTestJSON-63735962 None] Created volume successfully.
Nov 07 02:39:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-cdc3b198-d137-44b4-8500-026928cf9328 req-a7bc90c4-bd66-4df6-9328-089445c7a208 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c', 'name': 'volume-fb26835a-ee85-4460-8e0d-9b94037a34f6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5dca495c-d1c4-401b-860e-db4bf1594727', 'enforce_multipath': True} {{(pid=87054) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:39:28 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-cdc3b198-d137-44b4-8500-026928cf9328 req-a7bc90c4-bd66-4df6-9328-089445c7a208 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] attachment_update completed successfully.
Nov 07 02:39:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-ce26702c-e082-42f9-9772-5b373bec76c2 req-e6bc30ab-0802-4e88-b2fa-135e5c1f7c9b tempest-AttachVolumeTestJSON-63735962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-ce26702c-e082-42f9-9772-5b373bec76c2 req-e6bc30ab-0802-4e88-b2fa-135e5c1f7c9b tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-ce26702c-e082-42f9-9772-5b373bec76c2 req-e6bc30ab-0802-4e88-b2fa-135e5c1f7c9b tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-ce26702c-e082-42f9-9772-5b373bec76c2 req-e6bc30ab-0802-4e88-b2fa-135e5c1f7c9b tempest-AttachVolumeTestJSON-63735962 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c', 'name': 'volume-96ceeb69-f788-453e-b6c1-2fb82844d62b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b04a516-479b-4bee-888c-e8d30de565a3', 'enforce_multipath': True} {{(pid=87054) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:39:30 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-ce26702c-e082-42f9-9772-5b373bec76c2 req-e6bc30ab-0802-4e88-b2fa-135e5c1f7c9b tempest-AttachVolumeTestJSON-63735962 None] attachment_update completed successfully.
Nov 07 02:39:31 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-a6962fe0-f16a-4651-acdc-cd84bfae2f2f req-12a72b23-c373-4faf-b69c-683dce17dcf2 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Terminate volume connection completed successfully.
Nov 07 02:39:31 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-a6962fe0-f16a-4651-acdc-cd84bfae2f2f req-12a72b23-c373-4faf-b69c-683dce17dcf2 tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Deleting attachment 5dca495c-d1c4-401b-860e-db4bf1594727. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:39:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-143f59b4-5f76-4a66-bf4a-9bd0aef6b05f tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Acquiring lock "cinder-fb26835a-ee85-4460-8e0d-9b94037a34f6-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-143f59b4-5f76-4a66-bf4a-9bd0aef6b05f tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Lock "cinder-fb26835a-ee85-4460-8e0d-9b94037a34f6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-143f59b4-5f76-4a66-bf4a-9bd0aef6b05f tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Acquiring lock "cinder-quobyte-fb26835a-ee85-4460-8e0d-9b94037a34f6" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-143f59b4-5f76-4a66-bf4a-9bd0aef6b05f tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Lock "cinder-quobyte-fb26835a-ee85-4460-8e0d-9b94037a34f6" acquired by "delete_volume" :: waited 0.021s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:32 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b06a0a7-de15-495c-ba38-311eea99bb88]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-143f59b4-5f76-4a66-bf4a-9bd0aef6b05f tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fb26835a-ee85-4460-8e0d-9b94037a34f6 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:32 devstack sudo[98776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fb26835a-ee85-4460-8e0d-9b94037a34f6
Nov 07 02:39:32 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:32 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-143f59b4-5f76-4a66-bf4a-9bd0aef6b05f tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fb26835a-ee85-4460-8e0d-9b94037a34f6" returned: 0 in 0.566s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-143f59b4-5f76-4a66-bf4a-9bd0aef6b05f tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fb26835a-ee85-4460-8e0d-9b94037a34f6 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:32 devstack sudo[98782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fb26835a-ee85-4460-8e0d-9b94037a34f6
Nov 07 02:39:32 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:33 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-7dda4cca-e763-4a4e-98cb-6b3e97e2a2ac req-df1fd0a7-4bca-4b37-a930-e96537f817af tempest-AttachVolumeTestJSON-63735962 None] Terminate volume connection completed successfully.
Nov 07 02:39:33 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-7dda4cca-e763-4a4e-98cb-6b3e97e2a2ac req-df1fd0a7-4bca-4b37-a930-e96537f817af tempest-AttachVolumeTestJSON-63735962 None] Deleting attachment 6f695192-572c-4bc0-a5a9-347a8e7c0d6f. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:39:33 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-143f59b4-5f76-4a66-bf4a-9bd0aef6b05f tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fb26835a-ee85-4460-8e0d-9b94037a34f6" returned: 0 in 0.362s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-143f59b4-5f76-4a66-bf4a-9bd0aef6b05f tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Lock "cinder-quobyte-fb26835a-ee85-4460-8e0d-9b94037a34f6" released by "delete_volume" :: held 1.013s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:33 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-143f59b4-5f76-4a66-bf4a-9bd0aef6b05f tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Created reservations ['c15eaba7-3352-4a45-806a-a2a571d367b7', '33257de0-9ffc-4fe1-8d6a-39545ba25758', '0aeb264e-2bbe-41d2-abd1-611225b2183c', '4ea51282-de47-4c79-b9fa-a77a3ce5e998'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:39:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-143f59b4-5f76-4a66-bf4a-9bd0aef6b05f tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-143f59b4-5f76-4a66-bf4a-9bd0aef6b05f tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-143f59b4-5f76-4a66-bf4a-9bd0aef6b05f tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-143f59b4-5f76-4a66-bf4a-9bd0aef6b05f tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-143f59b4-5f76-4a66-bf4a-9bd0aef6b05f tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-143f59b4-5f76-4a66-bf4a-9bd0aef6b05f tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:33 devstack sudo[98787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:39:33 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:33 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-143f59b4-5f76-4a66-bf4a-9bd0aef6b05f tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.310s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:33 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-143f59b4-5f76-4a66-bf4a-9bd0aef6b05f tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:39:33 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-143f59b4-5f76-4a66-bf4a-9bd0aef6b05f tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Deleted volume successfully.
Nov 07 02:39:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-143f59b4-5f76-4a66-bf4a-9bd0aef6b05f tempest-TestServerVolumeAttachScenarioOldVersion-1254638124 None] Lock "cinder-fb26835a-ee85-4460-8e0d-9b94037a34f6-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:34 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-0b18219d-637a-4b33-83ce-c8cdb8cfe22a req-43818923-f280-474d-9a60-f1d70ce07410 tempest-AttachVolumeTestJSON-63735962 None] Terminate volume connection completed successfully.
Nov 07 02:39:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-0b18219d-637a-4b33-83ce-c8cdb8cfe22a req-43818923-f280-474d-9a60-f1d70ce07410 tempest-AttachVolumeTestJSON-63735962 None] Deleting attachment 8b04a516-479b-4bee-888c-e8d30de565a3. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Flow 'volume_create_manager' (ac80eb3f-4689-4cd3-a10a-e1d56b158d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f60192-b7f8-4d34-a654-466660f0b83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f60192-b7f8-4d34-a654-466660f0b83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-779966572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=758b1deb-683c-4fb6-8690-6a5035eeac06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6fcfe9e5c86405ebee8500da42a3456',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:35Z,use_quota=True,user_id='62b92af95f7847b5955f669263547ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e07dbe3a-0560-4f46-9d12-e5f3d5540ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e07dbe3a-0560-4f46-9d12-e5f3d5540ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4a5cb4-f904-4d6a-a0ed-3a9317bdcda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4a5cb4-f904-4d6a-a0ed-3a9317bdcda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '758b1deb-683c-4fb6-8690-6a5035eeac06', 'volume_name': 'volume-758b1deb-683c-4fb6-8690-6a5035eeac06', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04561240-eb1e-414b-8ccc-c1648de73fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04561240-eb1e-414b-8ccc-c1648de73fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c07db54-da92-4598-9b0a-6d6ae379dbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:35 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Volume 758b1deb-683c-4fb6-8690-6a5035eeac06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-758b1deb-683c-4fb6-8690-6a5035eeac06', 'volume_size': 1}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-779966572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=758b1deb-683c-4fb6-8690-6a5035eeac06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6fcfe9e5c86405ebee8500da42a3456',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:35Z,use_quota=True,user_id='62b92af95f7847b5955f669263547ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Creating volume 758b1deb-683c-4fb6-8690-6a5035eeac06 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:39:35 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-758b1deb-683c-4fb6-8690-6a5035eeac06 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:35 devstack sudo[98818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-758b1deb-683c-4fb6-8690-6a5035eeac06 1073741824
Nov 07 02:39:35 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Flow 'volume_create_manager' (91ad81db-ef0d-44ee-a266-9f11e27f8e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c938f7b-c581-4226-ab19-1f206e195013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c938f7b-c581-4226-ab19-1f206e195013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-563281725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea18f68a-84f7-4572-a19a-d43c14ca6701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='364e86d3d5784ae0b78541765a91bdd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:36Z,use_quota=True,user_id='130126b9cd9a4be9a3f38e12b3ecf169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0688dc89-a3c8-4978-a4d3-9182c51b3263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0688dc89-a3c8-4978-a4d3-9182c51b3263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208ba3b3-4294-4c1c-b411-30dbaa164d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:35 devstack cinder-volume[87054]: DEBUG cinder.image.glance [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Creating Keystone auth plugin from conf {{(pid=87054) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 07 02:39:36 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-758b1deb-683c-4fb6-8690-6a5035eeac06 1073741824" returned: 0 in 0.797s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-758b1deb-683c-4fb6-8690-6a5035eeac06 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:36 devstack sudo[98844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-758b1deb-683c-4fb6-8690-6a5035eeac06
Nov 07 02:39:36 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:36 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-758b1deb-683c-4fb6-8690-6a5035eeac06" returned: 0 in 0.278s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:39:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c07db54-da92-4598-9b0a-6d6ae379dbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-758b1deb-683c-4fb6-8690-6a5035eeac06', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff4337d-b591-4337-bb25-5c537c5a29a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:36 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Volume volume-758b1deb-683c-4fb6-8690-6a5035eeac06 (758b1deb-683c-4fb6-8690-6a5035eeac06): created successfully
Nov 07 02:39:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff4337d-b591-4337-bb25-5c537c5a29a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Flow 'volume_create_manager' (ac80eb3f-4689-4cd3-a10a-e1d56b158d03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:36 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ebc14610-0758-4dca-b44a-a8037f30c99e tempest-VolumesListAdminTestJSON-1918251442 None] Created volume successfully.
Nov 07 02:39:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208ba3b3-4294-4c1c-b411-30dbaa164d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ea18f68a-84f7-4572-a19a-d43c14ca6701', 'volume_name': 'volume-ea18f68a-84f7-4572-a19a-d43c14ca6701', 'volume_size': 1, 'image_id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567ec8d3497e4e06904abb9c1c036004', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 25, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72170a376ab0>}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca33ab1-97ed-45ef-911e-d25735500098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca33ab1-97ed-45ef-911e-d25735500098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd40a1a-a265-479d-830d-aff78071a2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:36 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Volume ea18f68a-84f7-4572-a19a-d43c14ca6701: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ea18f68a-84f7-4572-a19a-d43c14ca6701', 'volume_size': 1, 'image_id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567ec8d3497e4e06904abb9c1c036004', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 25, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72170a376ab0>}
Nov 07 02:39:36 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Trying to clone ea18f68a-84f7-4572-a19a-d43c14ca6701 from image b7a104a5-0b13-4f47-bea7-fab65f1346d5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}]). {{(pid=87054) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 07 02:39:37 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_mytbmltodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 07 02:39:37 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Image download 20.69 MB at 20.69 MB/s
Nov 07 02:39:37 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8bf65e-1b1c-40b8-950d-1912efb6071a]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_mytbmltodevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:37 devstack sudo[98867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_mytbmltodevstack@QuobyteHD
Nov 07 02:39:37 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:37 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_mytbmltodevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:37 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Temporary image b7a104a5-0b13-4f47-bea7-fab65f1346d5 is fetched for user 130126b9cd9a4be9a3f38e12b3ecf169. {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 07 02:39:37 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbed5432-ca0d-4ef6-abde-9406995e5501]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_mytbmltodevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:37 devstack sudo[98876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_mytbmltodevstack@QuobyteHD
Nov 07 02:39:37 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:38 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_mytbmltodevstack@QuobyteHD" returned: 0 in 0.509s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-563281725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea18f68a-84f7-4572-a19a-d43c14ca6701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='364e86d3d5784ae0b78541765a91bdd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:36Z,use_quota=True,user_id='130126b9cd9a4be9a3f38e12b3ecf169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Creating volume ea18f68a-84f7-4572-a19a-d43c14ca6701 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:39:38 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ea18f68a-84f7-4572-a19a-d43c14ca6701 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:39:38 devstack sudo[98881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ea18f68a-84f7-4572-a19a-d43c14ca6701 1073741824
Nov 07 02:39:38 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Flow 'volume_create_manager' (c6ec8fbd-53cf-4d18-bc47-5c6c717d66e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c63095-41b5-4682-a4f0-8551650e3845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c63095-41b5-4682-a4f0-8551650e3845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-762806963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b68c55-963e-4caf-a13f-f4559d02ef77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6fcfe9e5c86405ebee8500da42a3456',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:38Z,use_quota=True,user_id='62b92af95f7847b5955f669263547ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed792701-f0e6-4578-9b59-3104835d2ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed792701-f0e6-4578-9b59-3104835d2ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45b1673-117a-44dd-8378-25f98510083a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45b1673-117a-44dd-8378-25f98510083a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37b68c55-963e-4caf-a13f-f4559d02ef77', 'volume_name': 'volume-37b68c55-963e-4caf-a13f-f4559d02ef77', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687b96d7-81ef-42bb-9ae7-45391d02730d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687b96d7-81ef-42bb-9ae7-45391d02730d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b551529-9182-4f5c-9a98-4d44a71a18bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:38 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Volume 37b68c55-963e-4caf-a13f-f4559d02ef77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37b68c55-963e-4caf-a13f-f4559d02ef77', 'volume_size': 1}
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:38 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ea18f68a-84f7-4572-a19a-d43c14ca6701 1073741824" returned: 0 in 0.636s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ea18f68a-84f7-4572-a19a-d43c14ca6701 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:39 devstack sudo[98890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ea18f68a-84f7-4572-a19a-d43c14ca6701
Nov 07 02:39:39 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:39 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ea18f68a-84f7-4572-a19a-d43c14ca6701" returned: 0 in 0.284s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:39:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.788s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-762806963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b68c55-963e-4caf-a13f-f4559d02ef77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6fcfe9e5c86405ebee8500da42a3456',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:38Z,use_quota=True,user_id='62b92af95f7847b5955f669263547ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:39:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Creating volume 37b68c55-963e-4caf-a13f-f4559d02ef77 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:39:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:39:39 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:39:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-37b68c55-963e-4caf-a13f-f4559d02ef77 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:39 devstack sudo[98894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-37b68c55-963e-4caf-a13f-f4559d02ef77 1073741824
Nov 07 02:39:39 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:39 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Attempting download of b7a104a5-0b13-4f47-bea7-fab65f1346d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}])) to volume ea18f68a-84f7-4572-a19a-d43c14ca6701. {{(pid=87054) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 07 02:39:39 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[da184394-a001-4f65-8e2e-9a0859b75f23]: (4, 'raw') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_9ufzq7cu {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:39 devstack sudo[98896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_9ufzq7cu
Nov 07 02:39:39 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:39 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_9ufzq7cu" returned: 0 in 0.428s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_9ufzq7cu {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:39 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-37b68c55-963e-4caf-a13f-f4559d02ef77 1073741824" returned: 0 in 0.584s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-37b68c55-963e-4caf-a13f-f4559d02ef77 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:39 devstack sudo[98905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_9ufzq7cu
Nov 07 02:39:39 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:39 devstack sudo[98906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-37b68c55-963e-4caf-a13f-f4559d02ef77
Nov 07 02:39:39 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:40 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-37b68c55-963e-4caf-a13f-f4559d02ef77" returned: 0 in 0.309s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:39:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b551529-9182-4f5c-9a98-4d44a71a18bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37b68c55-963e-4caf-a13f-f4559d02ef77', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6af9896-4ee7-49c5-b25e-b3fc6c9d2162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:40 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Volume volume-37b68c55-963e-4caf-a13f-f4559d02ef77 (37b68c55-963e-4caf-a13f-f4559d02ef77): created successfully
Nov 07 02:39:40 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6af9896-4ee7-49c5-b25e-b3fc6c9d2162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Flow 'volume_create_manager' (c6ec8fbd-53cf-4d18-bc47-5c6c717d66e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_9ufzq7cu" returned: 1 in 0.517s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_9ufzq7cu' failed. Not Retrying. {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:39:40 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85b51b8-f207-40a1-aa11-a6de233576cf]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_mytbmltodevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:40 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-8df1bfb1-4fb1-4ac8-a722-408ad1022938 tempest-VolumesListAdminTestJSON-1918251442 None] Created volume successfully.
Nov 07 02:39:40 devstack sudo[98912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_mytbmltodevstack@QuobyteHD
Nov 07 02:39:40 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:40 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_mytbmltodevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:40 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] b7a104a5-0b13-4f47-bea7-fab65f1346d5 was qcow2, converting to qcow2 {{(pid=87054) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 07 02:39:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_mytbmltodevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ea18f68a-84f7-4572-a19a-d43c14ca6701 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:40 devstack sudo[98917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_mytbmltodevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ea18f68a-84f7-4572-a19a-d43c14ca6701
Nov 07 02:39:40 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Flow 'volume_create_manager' (c49cb996-d4db-4033-8a9a-c25bb9c1c2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1fd5cf-beee-49b3-99b0-f150549af36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1fd5cf-beee-49b3-99b0-f150549af36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-387582416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f84b60-c279-41a9-9e01-b8962871b896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6fcfe9e5c86405ebee8500da42a3456',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:42Z,use_quota=True,user_id='62b92af95f7847b5955f669263547ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14caf72d-0e02-4534-9a2f-6c26f3082fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14caf72d-0e02-4534-9a2f-6c26f3082fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806ba9ed-6b01-48c8-bfc9-5b306b37f56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806ba9ed-6b01-48c8-bfc9-5b306b37f56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38f84b60-c279-41a9-9e01-b8962871b896', 'volume_name': 'volume-38f84b60-c279-41a9-9e01-b8962871b896', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf048683-83ef-47e8-9178-f3119d7644a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf048683-83ef-47e8-9178-f3119d7644a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78421e6-5ce9-4a5a-a850-5e59cba692ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:42 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Volume 38f84b60-c279-41a9-9e01-b8962871b896: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38f84b60-c279-41a9-9e01-b8962871b896', 'volume_size': 1}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-387582416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f84b60-c279-41a9-9e01-b8962871b896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6fcfe9e5c86405ebee8500da42a3456',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:42Z,use_quota=True,user_id='62b92af95f7847b5955f669263547ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Creating volume 38f84b60-c279-41a9-9e01-b8962871b896 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:39:42 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-38f84b60-c279-41a9-9e01-b8962871b896 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:42 devstack sudo[98928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-38f84b60-c279-41a9-9e01-b8962871b896 1073741824
Nov 07 02:39:42 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-4ef9e246-3812-4179-b426-8572b31cb3cd tempest-AttachVolumeTestJSON-63735962 None] Acquiring lock "cinder-96ceeb69-f788-453e-b6c1-2fb82844d62b-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-4ef9e246-3812-4179-b426-8572b31cb3cd tempest-AttachVolumeTestJSON-63735962 None] Lock "cinder-96ceeb69-f788-453e-b6c1-2fb82844d62b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-4ef9e246-3812-4179-b426-8572b31cb3cd tempest-AttachVolumeTestJSON-63735962 None] Acquiring lock "cinder-quobyte-96ceeb69-f788-453e-b6c1-2fb82844d62b" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-4ef9e246-3812-4179-b426-8572b31cb3cd tempest-AttachVolumeTestJSON-63735962 None] Lock "cinder-quobyte-96ceeb69-f788-453e-b6c1-2fb82844d62b" acquired by "delete_volume" :: waited 0.027s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[02945add-6061-4fa9-a61e-f6598d9e3f1f]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4ef9e246-3812-4179-b426-8572b31cb3cd tempest-AttachVolumeTestJSON-63735962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-96ceeb69-f788-453e-b6c1-2fb82844d62b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:43 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-38f84b60-c279-41a9-9e01-b8962871b896 1073741824" returned: 0 in 0.775s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:43 devstack sudo[98936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-96ceeb69-f788-453e-b6c1-2fb82844d62b
Nov 07 02:39:43 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-38f84b60-c279-41a9-9e01-b8962871b896 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:43 devstack sudo[98938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-38f84b60-c279-41a9-9e01-b8962871b896
Nov 07 02:39:43 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:43 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_mytbmltodevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ea18f68a-84f7-4572-a19a-d43c14ca6701" returned: 0 in 2.521s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_mytbmltodevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ea18f68a-84f7-4572-a19a-d43c14ca6701 {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:39:43 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Converted 112.00 MB image at 44.40 MB/s
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ea18f68a-84f7-4572-a19a-d43c14ca6701 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:43 devstack sudo[98940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ea18f68a-84f7-4572-a19a-d43c14ca6701 1G
Nov 07 02:39:43 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:43 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4ef9e246-3812-4179-b426-8572b31cb3cd tempest-AttachVolumeTestJSON-63735962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-96ceeb69-f788-453e-b6c1-2fb82844d62b" returned: 0 in 0.624s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4ef9e246-3812-4179-b426-8572b31cb3cd tempest-AttachVolumeTestJSON-63735962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-96ceeb69-f788-453e-b6c1-2fb82844d62b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:43 devstack sudo[98948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-96ceeb69-f788-453e-b6c1-2fb82844d62b
Nov 07 02:39:43 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:43 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-38f84b60-c279-41a9-9e01-b8962871b896" returned: 0 in 0.385s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78421e6-5ce9-4a5a-a850-5e59cba692ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38f84b60-c279-41a9-9e01-b8962871b896', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec87cb4-a8ec-4c03-b1cf-6c08ac60d459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:43 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Volume volume-38f84b60-c279-41a9-9e01-b8962871b896 (38f84b60-c279-41a9-9e01-b8962871b896): created successfully
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec87cb4-a8ec-4c03-b1cf-6c08ac60d459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Flow 'volume_create_manager' (c49cb996-d4db-4033-8a9a-c25bb9c1c2f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:43 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-bf3de30f-b0fb-406b-8c86-414f70de29be tempest-VolumesListAdminTestJSON-1918251442 None] Created volume successfully.
Nov 07 02:39:43 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ea18f68a-84f7-4572-a19a-d43c14ca6701 1G" returned: 0 in 0.392s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Downloaded image b7a104a5-0b13-4f47-bea7-fab65f1346d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}])) to volume ea18f68a-84f7-4572-a19a-d43c14ca6701 successfully. {{(pid=87054) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Temporary image b7a104a5-0b13-4f47-bea7-fab65f1346d5 for user 130126b9cd9a4be9a3f38e12b3ecf169 is deleted. {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Marking volume ea18f68a-84f7-4572-a19a-d43c14ca6701 as bootable. {{(pid=87054) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Copying metadata from image b7a104a5-0b13-4f47-bea7-fab65f1346d5 to ea18f68a-84f7-4572-a19a-d43c14ca6701. {{(pid=87054) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Creating volume glance metadata for volume ea18f68a-84f7-4572-a19a-d43c14ca6701 backed by image b7a104a5-0b13-4f47-bea7-fab65f1346d5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87054) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd40a1a-a265-479d-830d-aff78071a2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea18f68a-84f7-4572-a19a-d43c14ca6701', 'volume_size': 1, 'image_id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567ec8d3497e4e06904abb9c1c036004', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 25, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72170a376ab0>}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f84c311c-9dda-474e-b0d8-f640e3fa0eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:43 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Volume volume-ea18f68a-84f7-4572-a19a-d43c14ca6701 (ea18f68a-84f7-4572-a19a-d43c14ca6701): created successfully
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f84c311c-9dda-474e-b0d8-f640e3fa0eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:43 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Flow 'volume_create_manager' (91ad81db-ef0d-44ee-a266-9f11e27f8e63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4ef9e246-3812-4179-b426-8572b31cb3cd tempest-AttachVolumeTestJSON-63735962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-96ceeb69-f788-453e-b6c1-2fb82844d62b" returned: 0 in 0.330s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-4ef9e246-3812-4179-b426-8572b31cb3cd tempest-AttachVolumeTestJSON-63735962 None] Lock "cinder-quobyte-96ceeb69-f788-453e-b6c1-2fb82844d62b" released by "delete_volume" :: held 1.060s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:43 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-18f686f2-1c01-4f98-8069-9eb138ee9af1 tempest-TestShelveInstance-1331364886 None] Created volume successfully.
Nov 07 02:39:43 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-4ef9e246-3812-4179-b426-8572b31cb3cd tempest-AttachVolumeTestJSON-63735962 None] Created reservations ['5bc7d5ad-8ea3-4370-a226-432e57132520', '9cd604c2-d558-4fc2-81dc-26ebefa101c4', '5dc9acfc-989b-49d6-bd9e-f701428541dc', '2627416f-4010-49c3-b05d-2ac3c8908bba'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:39:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-4ef9e246-3812-4179-b426-8572b31cb3cd tempest-AttachVolumeTestJSON-63735962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-4ef9e246-3812-4179-b426-8572b31cb3cd tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-4ef9e246-3812-4179-b426-8572b31cb3cd tempest-AttachVolumeTestJSON-63735962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-4ef9e246-3812-4179-b426-8572b31cb3cd tempest-AttachVolumeTestJSON-63735962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-4ef9e246-3812-4179-b426-8572b31cb3cd tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4ef9e246-3812-4179-b426-8572b31cb3cd tempest-AttachVolumeTestJSON-63735962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:44 devstack sudo[98953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:39:44 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:44 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4ef9e246-3812-4179-b426-8572b31cb3cd tempest-AttachVolumeTestJSON-63735962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.290s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:44 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-4ef9e246-3812-4179-b426-8572b31cb3cd tempest-AttachVolumeTestJSON-63735962 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:39:44 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-4ef9e246-3812-4179-b426-8572b31cb3cd tempest-AttachVolumeTestJSON-63735962 None] Deleted volume successfully.
Nov 07 02:39:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-4ef9e246-3812-4179-b426-8572b31cb3cd tempest-AttachVolumeTestJSON-63735962 None] Lock "cinder-96ceeb69-f788-453e-b6c1-2fb82844d62b-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5fa67f71-41ef-43b0-80a0-35f6084b6986 tempest-AttachVolumeTestJSON-63735962 None] Acquiring lock "cinder-2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5fa67f71-41ef-43b0-80a0-35f6084b6986 tempest-AttachVolumeTestJSON-63735962 None] Lock "cinder-2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5fa67f71-41ef-43b0-80a0-35f6084b6986 tempest-AttachVolumeTestJSON-63735962 None] Acquiring lock "cinder-quobyte-2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5fa67f71-41ef-43b0-80a0-35f6084b6986 tempest-AttachVolumeTestJSON-63735962 None] Lock "cinder-quobyte-2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1" acquired by "delete_volume" :: waited 0.032s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46a6d5d-7d28-46ae-8097-c7d9608c559d]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5fa67f71-41ef-43b0-80a0-35f6084b6986 tempest-AttachVolumeTestJSON-63735962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Flow 'volume_create_manager' (097a4db3-c3e1-4554-b626-ab87fd7a9062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97478449-412d-475c-84a6-82f06808a5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97478449-412d-475c-84a6-82f06808a5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47331996-192a-4e3b-84cd-8b82d0aac056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6900863571f14112821dc2e0727651d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:45Z,use_quota=True,user_id='095651f70654480cb315cb9346f13303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf95a3ca-3240-4c63-81b8-084dbd973e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf95a3ca-3240-4c63-81b8-084dbd973e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f6127b-5575-431d-8dca-a59dd5165185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f6127b-5575-431d-8dca-a59dd5165185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47331996-192a-4e3b-84cd-8b82d0aac056', 'volume_name': 'volume-47331996-192a-4e3b-84cd-8b82d0aac056', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a3b440-9e83-4448-bdef-b2517cd4ec89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a3b440-9e83-4448-bdef-b2517cd4ec89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a089bd-b90f-4e5c-88d0-60e1e32ddf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:45 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Volume 47331996-192a-4e3b-84cd-8b82d0aac056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47331996-192a-4e3b-84cd-8b82d0aac056', 'volume_size': 1}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47331996-192a-4e3b-84cd-8b82d0aac056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6900863571f14112821dc2e0727651d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:39:45Z,use_quota=True,user_id='095651f70654480cb315cb9346f13303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Creating volume 47331996-192a-4e3b-84cd-8b82d0aac056 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:39:45 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47331996-192a-4e3b-84cd-8b82d0aac056 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:45 devstack sudo[98956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1
Nov 07 02:39:45 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:45 devstack sudo[98958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47331996-192a-4e3b-84cd-8b82d0aac056 1073741824
Nov 07 02:39:45 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:45 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5fa67f71-41ef-43b0-80a0-35f6084b6986 tempest-AttachVolumeTestJSON-63735962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1" returned: 0 in 0.573s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5fa67f71-41ef-43b0-80a0-35f6084b6986 tempest-AttachVolumeTestJSON-63735962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:45 devstack sudo[98970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1
Nov 07 02:39:45 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:46 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47331996-192a-4e3b-84cd-8b82d0aac056 1073741824" returned: 0 in 0.745s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:46 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5fa67f71-41ef-43b0-80a0-35f6084b6986 tempest-AttachVolumeTestJSON-63735962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1" returned: 0 in 0.359s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5fa67f71-41ef-43b0-80a0-35f6084b6986 tempest-AttachVolumeTestJSON-63735962 None] Lock "cinder-quobyte-2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1" released by "delete_volume" :: held 1.033s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47331996-192a-4e3b-84cd-8b82d0aac056 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:46 devstack sudo[98975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47331996-192a-4e3b-84cd-8b82d0aac056
Nov 07 02:39:46 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:46 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-5fa67f71-41ef-43b0-80a0-35f6084b6986 tempest-AttachVolumeTestJSON-63735962 None] Created reservations ['3455a848-7dd0-463a-af4d-5018d46f9c57', '0069350f-04c2-4bf2-a7ee-fbbce48527ba', '20ce8985-ccbe-4848-85c3-f0064de4d9ab', 'd856fe55-7be0-4555-a053-cec53b7cf280'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:39:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5fa67f71-41ef-43b0-80a0-35f6084b6986 tempest-AttachVolumeTestJSON-63735962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5fa67f71-41ef-43b0-80a0-35f6084b6986 tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5fa67f71-41ef-43b0-80a0-35f6084b6986 tempest-AttachVolumeTestJSON-63735962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5fa67f71-41ef-43b0-80a0-35f6084b6986 tempest-AttachVolumeTestJSON-63735962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5fa67f71-41ef-43b0-80a0-35f6084b6986 tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5fa67f71-41ef-43b0-80a0-35f6084b6986 tempest-AttachVolumeTestJSON-63735962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:46 devstack sudo[98977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:39:46 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:46 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47331996-192a-4e3b-84cd-8b82d0aac056" returned: 0 in 0.398s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:39:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a089bd-b90f-4e5c-88d0-60e1e32ddf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47331996-192a-4e3b-84cd-8b82d0aac056', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38555173-7765-4c5c-b6e3-3ae485465208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:39:46 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Volume volume-47331996-192a-4e3b-84cd-8b82d0aac056 (47331996-192a-4e3b-84cd-8b82d0aac056): created successfully
Nov 07 02:39:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38555173-7765-4c5c-b6e3-3ae485465208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:39:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Flow 'volume_create_manager' (097a4db3-c3e1-4554-b626-ab87fd7a9062) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:39:46 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5fa67f71-41ef-43b0-80a0-35f6084b6986 tempest-AttachVolumeTestJSON-63735962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.306s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:46 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-5fa67f71-41ef-43b0-80a0-35f6084b6986 tempest-AttachVolumeTestJSON-63735962 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:39:46 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-5fa67f71-41ef-43b0-80a0-35f6084b6986 tempest-AttachVolumeTestJSON-63735962 None] Deleted volume successfully.
Nov 07 02:39:46 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-bf15990e-36e9-416b-b1bc-7cfdbb997389 tempest-VolumesListAdminTestJSON-786156314 None] Created volume successfully.
Nov 07 02:39:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5fa67f71-41ef-43b0-80a0-35f6084b6986 tempest-AttachVolumeTestJSON-63735962 None] Lock "cinder-2f92dbc7-b504-4c03-9aad-f5f9ac4f70e1-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-08a03fbc-335e-4f77-bf0f-87aacee88513 tempest-VolumesListAdminTestJSON-786156314 None] Acquiring lock "cinder-47331996-192a-4e3b-84cd-8b82d0aac056-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-08a03fbc-335e-4f77-bf0f-87aacee88513 tempest-VolumesListAdminTestJSON-786156314 None] Lock "cinder-47331996-192a-4e3b-84cd-8b82d0aac056-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-08a03fbc-335e-4f77-bf0f-87aacee88513 tempest-VolumesListAdminTestJSON-786156314 None] Acquiring lock "cinder-quobyte-47331996-192a-4e3b-84cd-8b82d0aac056" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-91946fb0-eeea-49a6-9f1e-17e31281141d tempest-AttachVolumeTestJSON-63735962 None] Acquiring lock "cinder-041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-08a03fbc-335e-4f77-bf0f-87aacee88513 tempest-VolumesListAdminTestJSON-786156314 None] Lock "cinder-quobyte-47331996-192a-4e3b-84cd-8b82d0aac056" acquired by "delete_volume" :: waited 0.059s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-91946fb0-eeea-49a6-9f1e-17e31281141d tempest-AttachVolumeTestJSON-63735962 None] Lock "cinder-041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:47 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffda2922-c5e3-4172-8568-c3901e9df468]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-08a03fbc-335e-4f77-bf0f-87aacee88513 tempest-VolumesListAdminTestJSON-786156314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47331996-192a-4e3b-84cd-8b82d0aac056 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5c85e863-27b7-45ac-9274-a466596e29ee tempest-VolumesListAdminTestJSON-1918251442 None] Acquiring lock "cinder-38f84b60-c279-41a9-9e01-b8962871b896-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-2bdbb1cf-6985-49b0-9b85-ad10656d54b0 req-08e6cfe5-b9c8-4bea-be45-533a55c95296 tempest-TestShelveInstance-1331364886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-2bdbb1cf-6985-49b0-9b85-ad10656d54b0 req-08e6cfe5-b9c8-4bea-be45-533a55c95296 tempest-TestShelveInstance-1331364886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5c85e863-27b7-45ac-9274-a466596e29ee tempest-VolumesListAdminTestJSON-1918251442 None] Lock "cinder-38f84b60-c279-41a9-9e01-b8962871b896-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-2bdbb1cf-6985-49b0-9b85-ad10656d54b0 req-08e6cfe5-b9c8-4bea-be45-533a55c95296 tempest-TestShelveInstance-1331364886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.054s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-91946fb0-eeea-49a6-9f1e-17e31281141d tempest-AttachVolumeTestJSON-63735962 None] Acquiring lock "cinder-quobyte-041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-91946fb0-eeea-49a6-9f1e-17e31281141d tempest-AttachVolumeTestJSON-63735962 None] Lock "cinder-quobyte-041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3" acquired by "delete_volume" :: waited 0.065s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:47 devstack sudo[98991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47331996-192a-4e3b-84cd-8b82d0aac056
Nov 07 02:39:47 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:47 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ac8129-ce57-4713-b671-c13da90d1601]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-91946fb0-eeea-49a6-9f1e-17e31281141d tempest-AttachVolumeTestJSON-63735962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-2bdbb1cf-6985-49b0-9b85-ad10656d54b0 req-08e6cfe5-b9c8-4bea-be45-533a55c95296 tempest-TestShelveInstance-1331364886 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c', 'name': 'volume-ea18f68a-84f7-4572-a19a-d43c14ca6701', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fede6c49-6440-4f42-8e19-cb39de717464', 'enforce_multipath': True} {{(pid=87054) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:39:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5c85e863-27b7-45ac-9274-a466596e29ee tempest-VolumesListAdminTestJSON-1918251442 None] Acquiring lock "cinder-quobyte-38f84b60-c279-41a9-9e01-b8962871b896" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5c85e863-27b7-45ac-9274-a466596e29ee tempest-VolumesListAdminTestJSON-1918251442 None] Lock "cinder-quobyte-38f84b60-c279-41a9-9e01-b8962871b896" acquired by "delete_volume" :: waited 0.042s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:48 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b321a5c-3608-453b-9fd1-b69422324555]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5c85e863-27b7-45ac-9274-a466596e29ee tempest-VolumesListAdminTestJSON-1918251442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-38f84b60-c279-41a9-9e01-b8962871b896 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:48 devstack sudo[98993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3
Nov 07 02:39:48 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:48 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-2bdbb1cf-6985-49b0-9b85-ad10656d54b0 req-08e6cfe5-b9c8-4bea-be45-533a55c95296 tempest-TestShelveInstance-1331364886 None] attachment_update completed successfully.
Nov 07 02:39:48 devstack sudo[98994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-38f84b60-c279-41a9-9e01-b8962871b896
Nov 07 02:39:48 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:48 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-08a03fbc-335e-4f77-bf0f-87aacee88513 tempest-VolumesListAdminTestJSON-786156314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47331996-192a-4e3b-84cd-8b82d0aac056" returned: 0 in 0.644s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-08a03fbc-335e-4f77-bf0f-87aacee88513 tempest-VolumesListAdminTestJSON-786156314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47331996-192a-4e3b-84cd-8b82d0aac056 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:48 devstack sudo[99000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47331996-192a-4e3b-84cd-8b82d0aac056
Nov 07 02:39:48 devstack sudo[99000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:48 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-91946fb0-eeea-49a6-9f1e-17e31281141d tempest-AttachVolumeTestJSON-63735962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3" returned: 0 in 0.753s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-91946fb0-eeea-49a6-9f1e-17e31281141d tempest-AttachVolumeTestJSON-63735962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:48 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5c85e863-27b7-45ac-9274-a466596e29ee tempest-VolumesListAdminTestJSON-1918251442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-38f84b60-c279-41a9-9e01-b8962871b896" returned: 0 in 0.663s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5c85e863-27b7-45ac-9274-a466596e29ee tempest-VolumesListAdminTestJSON-1918251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-38f84b60-c279-41a9-9e01-b8962871b896 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:48 devstack sudo[99008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3
Nov 07 02:39:48 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:48 devstack sudo[99009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-38f84b60-c279-41a9-9e01-b8962871b896
Nov 07 02:39:48 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:48 devstack sudo[99000]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-08a03fbc-335e-4f77-bf0f-87aacee88513 tempest-VolumesListAdminTestJSON-786156314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47331996-192a-4e3b-84cd-8b82d0aac056" returned: 0 in 0.553s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-08a03fbc-335e-4f77-bf0f-87aacee88513 tempest-VolumesListAdminTestJSON-786156314 None] Lock "cinder-quobyte-47331996-192a-4e3b-84cd-8b82d0aac056" released by "delete_volume" :: held 1.307s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-08a03fbc-335e-4f77-bf0f-87aacee88513 tempest-VolumesListAdminTestJSON-786156314 None] Created reservations ['0f3505df-60f9-4926-ae56-6301b8c12e3e', '9597f012-6492-4144-ab8c-7f78ab11447f', 'fbf888b4-e823-4226-8fbe-3f3ea554d74e', '158ed383-3bb2-44df-9f0f-f4950ff54b62'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:39:49 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-91946fb0-eeea-49a6-9f1e-17e31281141d tempest-AttachVolumeTestJSON-63735962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3" returned: 0 in 0.446s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-91946fb0-eeea-49a6-9f1e-17e31281141d tempest-AttachVolumeTestJSON-63735962 None] Lock "cinder-quobyte-041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3" released by "delete_volume" :: held 1.305s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:49 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5c85e863-27b7-45ac-9274-a466596e29ee tempest-VolumesListAdminTestJSON-1918251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-38f84b60-c279-41a9-9e01-b8962871b896" returned: 0 in 0.460s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-08a03fbc-335e-4f77-bf0f-87aacee88513 tempest-VolumesListAdminTestJSON-786156314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-08a03fbc-335e-4f77-bf0f-87aacee88513 tempest-VolumesListAdminTestJSON-786156314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-08a03fbc-335e-4f77-bf0f-87aacee88513 tempest-VolumesListAdminTestJSON-786156314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-08a03fbc-335e-4f77-bf0f-87aacee88513 tempest-VolumesListAdminTestJSON-786156314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-08a03fbc-335e-4f77-bf0f-87aacee88513 tempest-VolumesListAdminTestJSON-786156314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-08a03fbc-335e-4f77-bf0f-87aacee88513 tempest-VolumesListAdminTestJSON-786156314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5c85e863-27b7-45ac-9274-a466596e29ee tempest-VolumesListAdminTestJSON-1918251442 None] Lock "cinder-quobyte-38f84b60-c279-41a9-9e01-b8962871b896" released by "delete_volume" :: held 1.222s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:49 devstack sudo[99015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:39:49 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-91946fb0-eeea-49a6-9f1e-17e31281141d tempest-AttachVolumeTestJSON-63735962 None] Created reservations ['c4104964-d234-480c-9540-01e0d74166aa', '88436cc2-f721-446e-ba35-a565f32a0593', 'a42b0fdd-0b96-4b99-b770-e7eeda2025de', '5d7e7a4c-3b6d-4e88-a9e0-a5390178f1e6'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-5c85e863-27b7-45ac-9274-a466596e29ee tempest-VolumesListAdminTestJSON-1918251442 None] Created reservations ['8b47c724-f943-4a1b-b772-3fffb1c358d5', '7768b0fc-49fe-4c2c-8e52-6583594a1df3', '13b84511-98b9-42cd-8570-566c952971bb', '2117b594-6a2b-403c-84d7-8129b6dbf629'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-91946fb0-eeea-49a6-9f1e-17e31281141d tempest-AttachVolumeTestJSON-63735962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-91946fb0-eeea-49a6-9f1e-17e31281141d tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-91946fb0-eeea-49a6-9f1e-17e31281141d tempest-AttachVolumeTestJSON-63735962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-91946fb0-eeea-49a6-9f1e-17e31281141d tempest-AttachVolumeTestJSON-63735962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-91946fb0-eeea-49a6-9f1e-17e31281141d tempest-AttachVolumeTestJSON-63735962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-91946fb0-eeea-49a6-9f1e-17e31281141d tempest-AttachVolumeTestJSON-63735962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5c85e863-27b7-45ac-9274-a466596e29ee tempest-VolumesListAdminTestJSON-1918251442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5c85e863-27b7-45ac-9274-a466596e29ee tempest-VolumesListAdminTestJSON-1918251442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:49 devstack sudo[99018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5c85e863-27b7-45ac-9274-a466596e29ee tempest-VolumesListAdminTestJSON-1918251442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:49 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5c85e863-27b7-45ac-9274-a466596e29ee tempest-VolumesListAdminTestJSON-1918251442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5c85e863-27b7-45ac-9274-a466596e29ee tempest-VolumesListAdminTestJSON-1918251442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5c85e863-27b7-45ac-9274-a466596e29ee tempest-VolumesListAdminTestJSON-1918251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:49 devstack sudo[99020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:39:49 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:49 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-08a03fbc-335e-4f77-bf0f-87aacee88513 tempest-VolumesListAdminTestJSON-786156314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.445s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-08a03fbc-335e-4f77-bf0f-87aacee88513 tempest-VolumesListAdminTestJSON-786156314 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:39:49 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-08a03fbc-335e-4f77-bf0f-87aacee88513 tempest-VolumesListAdminTestJSON-786156314 None] Deleted volume successfully.
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-08a03fbc-335e-4f77-bf0f-87aacee88513 tempest-VolumesListAdminTestJSON-786156314 None] Lock "cinder-47331996-192a-4e3b-84cd-8b82d0aac056-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:49 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-91946fb0-eeea-49a6-9f1e-17e31281141d tempest-AttachVolumeTestJSON-63735962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.320s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-91946fb0-eeea-49a6-9f1e-17e31281141d tempest-AttachVolumeTestJSON-63735962 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:39:49 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-91946fb0-eeea-49a6-9f1e-17e31281141d tempest-AttachVolumeTestJSON-63735962 None] Deleted volume successfully.
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-91946fb0-eeea-49a6-9f1e-17e31281141d tempest-AttachVolumeTestJSON-63735962 None] Lock "cinder-041bbc5b-4dd1-4bfc-8ae7-1dc9bb7eddb3-delete_volume" released by "delete_volume" :: held 2.176s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:49 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5c85e863-27b7-45ac-9274-a466596e29ee tempest-VolumesListAdminTestJSON-1918251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.349s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-5c85e863-27b7-45ac-9274-a466596e29ee tempest-VolumesListAdminTestJSON-1918251442 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:39:49 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-5c85e863-27b7-45ac-9274-a466596e29ee tempest-VolumesListAdminTestJSON-1918251442 None] Deleted volume successfully.
Nov 07 02:39:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5c85e863-27b7-45ac-9274-a466596e29ee tempest-VolumesListAdminTestJSON-1918251442 None] Lock "cinder-38f84b60-c279-41a9-9e01-b8962871b896-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-50e88d5f-c2ad-4baa-b700-e797aa4534a9 tempest-VolumesListAdminTestJSON-1918251442 None] Acquiring lock "cinder-37b68c55-963e-4caf-a13f-f4559d02ef77-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-50e88d5f-c2ad-4baa-b700-e797aa4534a9 tempest-VolumesListAdminTestJSON-1918251442 None] Lock "cinder-37b68c55-963e-4caf-a13f-f4559d02ef77-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-50e88d5f-c2ad-4baa-b700-e797aa4534a9 tempest-VolumesListAdminTestJSON-1918251442 None] Acquiring lock "cinder-quobyte-37b68c55-963e-4caf-a13f-f4559d02ef77" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-50e88d5f-c2ad-4baa-b700-e797aa4534a9 tempest-VolumesListAdminTestJSON-1918251442 None] Lock "cinder-quobyte-37b68c55-963e-4caf-a13f-f4559d02ef77" acquired by "delete_volume" :: waited 0.026s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:50 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da81903-99ae-4e22-8fdc-7268b0d946b6]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-50e88d5f-c2ad-4baa-b700-e797aa4534a9 tempest-VolumesListAdminTestJSON-1918251442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-37b68c55-963e-4caf-a13f-f4559d02ef77 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:50 devstack sudo[99026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-37b68c55-963e-4caf-a13f-f4559d02ef77
Nov 07 02:39:50 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:50 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-50e88d5f-c2ad-4baa-b700-e797aa4534a9 tempest-VolumesListAdminTestJSON-1918251442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-37b68c55-963e-4caf-a13f-f4559d02ef77" returned: 0 in 0.400s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-50e88d5f-c2ad-4baa-b700-e797aa4534a9 tempest-VolumesListAdminTestJSON-1918251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-37b68c55-963e-4caf-a13f-f4559d02ef77 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:50 devstack sudo[99031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-37b68c55-963e-4caf-a13f-f4559d02ef77
Nov 07 02:39:50 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:51 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-50e88d5f-c2ad-4baa-b700-e797aa4534a9 tempest-VolumesListAdminTestJSON-1918251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-37b68c55-963e-4caf-a13f-f4559d02ef77" returned: 0 in 0.271s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-50e88d5f-c2ad-4baa-b700-e797aa4534a9 tempest-VolumesListAdminTestJSON-1918251442 None] Lock "cinder-quobyte-37b68c55-963e-4caf-a13f-f4559d02ef77" released by "delete_volume" :: held 0.726s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:51 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-50e88d5f-c2ad-4baa-b700-e797aa4534a9 tempest-VolumesListAdminTestJSON-1918251442 None] Created reservations ['e99ae2bc-9a53-4ff5-bd1a-86e660ef8f60', 'dc62eebe-d45a-4cf0-99ce-98110137c75e', '8f4f45d3-641e-406f-9a46-751970ee17df', 'a4ff629c-3e0f-4f06-9ce2-f07bb9de92d3'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:39:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-50e88d5f-c2ad-4baa-b700-e797aa4534a9 tempest-VolumesListAdminTestJSON-1918251442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-50e88d5f-c2ad-4baa-b700-e797aa4534a9 tempest-VolumesListAdminTestJSON-1918251442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:51 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-50e88d5f-c2ad-4baa-b700-e797aa4534a9 tempest-VolumesListAdminTestJSON-1918251442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:51 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-50e88d5f-c2ad-4baa-b700-e797aa4534a9 tempest-VolumesListAdminTestJSON-1918251442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-50e88d5f-c2ad-4baa-b700-e797aa4534a9 tempest-VolumesListAdminTestJSON-1918251442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-50e88d5f-c2ad-4baa-b700-e797aa4534a9 tempest-VolumesListAdminTestJSON-1918251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:51 devstack sudo[99034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:39:51 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:51 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b97b78ef-af25-48dd-a300-febd1187e1b2 tempest-VolumesListAdminTestJSON-1918251442 None] Acquiring lock "cinder-758b1deb-683c-4fb6-8690-6a5035eeac06-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-50e88d5f-c2ad-4baa-b700-e797aa4534a9 tempest-VolumesListAdminTestJSON-1918251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.262s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:51 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-50e88d5f-c2ad-4baa-b700-e797aa4534a9 tempest-VolumesListAdminTestJSON-1918251442 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:39:51 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-50e88d5f-c2ad-4baa-b700-e797aa4534a9 tempest-VolumesListAdminTestJSON-1918251442 None] Deleted volume successfully.
Nov 07 02:39:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b97b78ef-af25-48dd-a300-febd1187e1b2 tempest-VolumesListAdminTestJSON-1918251442 None] Lock "cinder-758b1deb-683c-4fb6-8690-6a5035eeac06-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-50e88d5f-c2ad-4baa-b700-e797aa4534a9 tempest-VolumesListAdminTestJSON-1918251442 None] Lock "cinder-37b68c55-963e-4caf-a13f-f4559d02ef77-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b97b78ef-af25-48dd-a300-febd1187e1b2 tempest-VolumesListAdminTestJSON-1918251442 None] Acquiring lock "cinder-quobyte-758b1deb-683c-4fb6-8690-6a5035eeac06" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:39:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b97b78ef-af25-48dd-a300-febd1187e1b2 tempest-VolumesListAdminTestJSON-1918251442 None] Lock "cinder-quobyte-758b1deb-683c-4fb6-8690-6a5035eeac06" acquired by "delete_volume" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:39:51 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b428d6-3852-48ba-a653-4c0ab88b7a2f]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:39:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b97b78ef-af25-48dd-a300-febd1187e1b2 tempest-VolumesListAdminTestJSON-1918251442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-758b1deb-683c-4fb6-8690-6a5035eeac06 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:51 devstack sudo[99037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-758b1deb-683c-4fb6-8690-6a5035eeac06
Nov 07 02:39:51 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:52 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b97b78ef-af25-48dd-a300-febd1187e1b2 tempest-VolumesListAdminTestJSON-1918251442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-758b1deb-683c-4fb6-8690-6a5035eeac06" returned: 0 in 0.522s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b97b78ef-af25-48dd-a300-febd1187e1b2 tempest-VolumesListAdminTestJSON-1918251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-758b1deb-683c-4fb6-8690-6a5035eeac06 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:52 devstack sudo[99042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-758b1deb-683c-4fb6-8690-6a5035eeac06
Nov 07 02:39:52 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:52 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b97b78ef-af25-48dd-a300-febd1187e1b2 tempest-VolumesListAdminTestJSON-1918251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-758b1deb-683c-4fb6-8690-6a5035eeac06" returned: 0 in 0.308s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b97b78ef-af25-48dd-a300-febd1187e1b2 tempest-VolumesListAdminTestJSON-1918251442 None] Lock "cinder-quobyte-758b1deb-683c-4fb6-8690-6a5035eeac06" released by "delete_volume" :: held 0.882s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:52 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-b97b78ef-af25-48dd-a300-febd1187e1b2 tempest-VolumesListAdminTestJSON-1918251442 None] Created reservations ['919f3f45-267f-4f57-9fb1-7e2d618b290a', 'd72092de-d5d9-440e-836a-4c6861d307c4', '0693bd0c-e90f-4553-93a4-bd9680ac7013', 'dd8f29bc-a68b-4cac-b824-1ec72f10609b'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:39:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b97b78ef-af25-48dd-a300-febd1187e1b2 tempest-VolumesListAdminTestJSON-1918251442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b97b78ef-af25-48dd-a300-febd1187e1b2 tempest-VolumesListAdminTestJSON-1918251442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b97b78ef-af25-48dd-a300-febd1187e1b2 tempest-VolumesListAdminTestJSON-1918251442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b97b78ef-af25-48dd-a300-febd1187e1b2 tempest-VolumesListAdminTestJSON-1918251442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b97b78ef-af25-48dd-a300-febd1187e1b2 tempest-VolumesListAdminTestJSON-1918251442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b97b78ef-af25-48dd-a300-febd1187e1b2 tempest-VolumesListAdminTestJSON-1918251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:52 devstack sudo[99045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:39:52 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:52 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b97b78ef-af25-48dd-a300-febd1187e1b2 tempest-VolumesListAdminTestJSON-1918251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.398s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:53 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-b97b78ef-af25-48dd-a300-febd1187e1b2 tempest-VolumesListAdminTestJSON-1918251442 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:39:53 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b97b78ef-af25-48dd-a300-febd1187e1b2 tempest-VolumesListAdminTestJSON-1918251442 None] Deleted volume successfully.
Nov 07 02:39:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b97b78ef-af25-48dd-a300-febd1187e1b2 tempest-VolumesListAdminTestJSON-1918251442 None] Lock "cinder-758b1deb-683c-4fb6-8690-6a5035eeac06-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:39:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:39:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:39:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:39:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:39:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:39:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:39:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:39:59 devstack sudo[99568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:39:59 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:39:59 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root
Nov 07 02:39:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.424s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:39:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:39:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:39:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 28 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:39:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>, <Thread(fd_logger, started daemon 125443282798592)>, <Thread(privsep_reader, started daemon 125443284556288)>, <Thread(tpool_thread_0, started daemon 125443276445376)>, <Thread(tpool_thread_1, started daemon 125443268036288)>, <Thread(tpool_thread_2, started daemon 125443259627200)>, <Thread(tpool_thread_3, started daemon 125443251218112)>, <Thread(tpool_thread_4, started daemon 125443242809024)>, <Thread(tpool_thread_5, started daemon 125443234399936)>, <Thread(tpool_thread_6, started daemon 125443225990848)>, <Thread(tpool_thread_7, started daemon 125443217581760)>, <Thread(tpool_thread_8, started daemon 125443209172672)>, <Thread(tpool_thread_9, started daemon 125443200763584)>, <Thread(tpool_thread_10, started daemon 125443192354496)>, <Thread(tpool_thread_11, started daemon 125443183945408)>, <Thread(tpool_thread_12, started daemon 125443175536320)>, <Thread(tpool_thread_13, started daemon 125443167127232)>, <Thread(tpool_thread_14, started daemon 125443158718144)>, <Thread(tpool_thread_15, started daemon 125443150309056)>, <Thread(tpool_thread_16, started daemon 125443141899968)>, <Thread(tpool_thread_17, started daemon 125443133490880)>, <Thread(tpool_thread_18, started daemon 125443125081792)>, <Thread(tpool_thread_19, started daemon 125443116672704)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:40:02 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=87,cinder:UPDATE=97,cinder:DELETE=9,cinder:INSERT=28 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:40:03 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=99,cinder:UPDATE=95,cinder:INSERT=25,cinder:DELETE=7 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:40:03 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:40:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Flow 'volume_create_manager' (3298d03b-97fa-4850-9aed-a2a6616bcbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e6166a-c9fc-46b2-a730-a0e2c82f4aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e6166a-c9fc-46b2-a730-a0e2c82f4aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1632315590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d215070d-75b4-4034-b101-e5c1b4699a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2312ec855341da8e343975732104d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:03Z,use_quota=True,user_id='be426c337cdd40da8cf4593850cd64e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeaa9b26-4cff-40cf-be45-736012e58b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeaa9b26-4cff-40cf-be45-736012e58b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac0b88d-a1ba-48a1-85d0-e840ce84a550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac0b88d-a1ba-48a1-85d0-e840ce84a550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd215070d-75b4-4034-b101-e5c1b4699a27', 'volume_name': 'volume-d215070d-75b4-4034-b101-e5c1b4699a27', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f312d76-3a58-4a92-bd58-22b533f385e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f312d76-3a58-4a92-bd58-22b533f385e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95463663-d717-4d9b-97a6-454088864e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:03 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Volume d215070d-75b4-4034-b101-e5c1b4699a27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d215070d-75b4-4034-b101-e5c1b4699a27', 'volume_size': 1}
Nov 07 02:40:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1632315590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d215070d-75b4-4034-b101-e5c1b4699a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2312ec855341da8e343975732104d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:03Z,use_quota=True,user_id='be426c337cdd40da8cf4593850cd64e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:40:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Creating volume d215070d-75b4-4034-b101-e5c1b4699a27 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:40:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:40:03 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:40:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d215070d-75b4-4034-b101-e5c1b4699a27 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:03 devstack sudo[99574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d215070d-75b4-4034-b101-e5c1b4699a27 1073741824
Nov 07 02:40:03 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:04 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d215070d-75b4-4034-b101-e5c1b4699a27 1073741824" returned: 0 in 0.677s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d215070d-75b4-4034-b101-e5c1b4699a27 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:04 devstack sudo[99580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d215070d-75b4-4034-b101-e5c1b4699a27
Nov 07 02:40:04 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:04 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d215070d-75b4-4034-b101-e5c1b4699a27" returned: 0 in 0.278s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95463663-d717-4d9b-97a6-454088864e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d215070d-75b4-4034-b101-e5c1b4699a27', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a01da0c1-104c-4f1e-bdbe-5d6a51a9aa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:04 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Volume volume-d215070d-75b4-4034-b101-e5c1b4699a27 (d215070d-75b4-4034-b101-e5c1b4699a27): created successfully
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a01da0c1-104c-4f1e-bdbe-5d6a51a9aa3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Flow 'volume_create_manager' (3298d03b-97fa-4850-9aed-a2a6616bcbbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:04 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-e4a6f152-1693-4855-a54d-6f2587965ac3 tempest-ProjectReaderTests-1071894449 None] Created volume successfully.
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Flow 'volume_create_manager' (907efa16-64c6-4b0e-b7a7-602df28cc9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e688c874-610b-41e5-80e7-3cead5fcb0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e688c874-610b-41e5-80e7-3cead5fcb0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-206465134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453cfbb2-7422-4a32-a9fc-bba55d72f6b7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='491bf16efe514c979f902263f9954cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:05Z,use_quota=True,user_id='9d0314a4017147128f2a947df8cd8128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54870ca-9704-4cbb-afc4-a391875f26ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54870ca-9704-4cbb-afc4-a391875f26ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f603a3-8272-4890-ad4d-c6cf3301b67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f603a3-8272-4890-ad4d-c6cf3301b67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '453cfbb2-7422-4a32-a9fc-bba55d72f6b7', 'volume_name': 'volume-453cfbb2-7422-4a32-a9fc-bba55d72f6b7', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32c16e93-32cf-4283-8383-1279aee7e00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32c16e93-32cf-4283-8383-1279aee7e00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e902cf-dcc0-427a-b84e-44a72bdbd7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:04 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Volume 453cfbb2-7422-4a32-a9fc-bba55d72f6b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-453cfbb2-7422-4a32-a9fc-bba55d72f6b7', 'volume_size': 1}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-206465134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453cfbb2-7422-4a32-a9fc-bba55d72f6b7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='491bf16efe514c979f902263f9954cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:05Z,use_quota=True,user_id='9d0314a4017147128f2a947df8cd8128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Creating volume 453cfbb2-7422-4a32-a9fc-bba55d72f6b7 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:40:04 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:40:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-453cfbb2-7422-4a32-a9fc-bba55d72f6b7 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:04 devstack sudo[99583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-453cfbb2-7422-4a32-a9fc-bba55d72f6b7 1073741824
Nov 07 02:40:04 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Flow 'volume_create_manager' (9d7007fd-c716-48e5-bedf-0ce02287a5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f3024a-eea7-4c1a-8958-b95d1a52dd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f3024a-eea7-4c1a-8958-b95d1a52dd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-592935075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1fb4758-ce87-471b-900e-27ef71da9728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e06c7a41204045a89934d98ac2b89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:05Z,use_quota=True,user_id='9fbbd31dd3d145408a63f448d270ed9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa075028-0a09-4814-ad2e-618302bf682b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa075028-0a09-4814-ad2e-618302bf682b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4de16e-fc97-4442-aed5-380ceea69293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4de16e-fc97-4442-aed5-380ceea69293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1fb4758-ce87-471b-900e-27ef71da9728', 'volume_name': 'volume-b1fb4758-ce87-471b-900e-27ef71da9728', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (870770fa-16f6-4a95-8e9e-d05a2357e299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (870770fa-16f6-4a95-8e9e-d05a2357e299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988badf7-b754-4560-82f4-49f62abe2c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:05 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Volume b1fb4758-ce87-471b-900e-27ef71da9728: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1fb4758-ce87-471b-900e-27ef71da9728', 'volume_size': 1}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:05 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-453cfbb2-7422-4a32-a9fc-bba55d72f6b7 1073741824" returned: 0 in 0.491s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-453cfbb2-7422-4a32-a9fc-bba55d72f6b7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c2842842-151d-40a7-a1f3-4ea0f01704d0 tempest-ProjectReaderTests-1071894449 None] Acquiring lock "cinder-d215070d-75b4-4034-b101-e5c1b4699a27-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c2842842-151d-40a7-a1f3-4ea0f01704d0 tempest-ProjectReaderTests-1071894449 None] Lock "cinder-d215070d-75b4-4034-b101-e5c1b4699a27-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:05 devstack sudo[99589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-453cfbb2-7422-4a32-a9fc-bba55d72f6b7
Nov 07 02:40:05 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c2842842-151d-40a7-a1f3-4ea0f01704d0 tempest-ProjectReaderTests-1071894449 None] Acquiring lock "cinder-quobyte-d215070d-75b4-4034-b101-e5c1b4699a27" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c2842842-151d-40a7-a1f3-4ea0f01704d0 tempest-ProjectReaderTests-1071894449 None] Lock "cinder-quobyte-d215070d-75b4-4034-b101-e5c1b4699a27" acquired by "delete_volume" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2460d9-bbac-4c9f-9dfe-d5d630f09496]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c2842842-151d-40a7-a1f3-4ea0f01704d0 tempest-ProjectReaderTests-1071894449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d215070d-75b4-4034-b101-e5c1b4699a27 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:05 devstack sudo[99591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d215070d-75b4-4034-b101-e5c1b4699a27
Nov 07 02:40:05 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:05 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-453cfbb2-7422-4a32-a9fc-bba55d72f6b7" returned: 0 in 0.279s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.394s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-592935075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1fb4758-ce87-471b-900e-27ef71da9728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e06c7a41204045a89934d98ac2b89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:05Z,use_quota=True,user_id='9fbbd31dd3d145408a63f448d270ed9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Creating volume b1fb4758-ce87-471b-900e-27ef71da9728 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:40:05 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b1fb4758-ce87-471b-900e-27ef71da9728 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:05 devstack sudo[99594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b1fb4758-ce87-471b-900e-27ef71da9728 1073741824
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e902cf-dcc0-427a-b84e-44a72bdbd7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-453cfbb2-7422-4a32-a9fc-bba55d72f6b7', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:05 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf5c3b4e-cc91-476f-b9d3-de0203dcdd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:05 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Volume volume-453cfbb2-7422-4a32-a9fc-bba55d72f6b7 (453cfbb2-7422-4a32-a9fc-bba55d72f6b7): created successfully
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf5c3b4e-cc91-476f-b9d3-de0203dcdd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Flow 'volume_create_manager' (907efa16-64c6-4b0e-b7a7-602df28cc9ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:05 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-b149c26b-9402-4a80-8992-40a16e3aff3b req-abc9a146-6cd9-46c9-98bb-f1171bf5d52d tempest-VolumesGetTestJSON-1054864378 None] Created volume successfully.
Nov 07 02:40:06 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c2842842-151d-40a7-a1f3-4ea0f01704d0 tempest-ProjectReaderTests-1071894449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d215070d-75b4-4034-b101-e5c1b4699a27" returned: 0 in 0.465s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c2842842-151d-40a7-a1f3-4ea0f01704d0 tempest-ProjectReaderTests-1071894449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d215070d-75b4-4034-b101-e5c1b4699a27 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:06 devstack sudo[99601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d215070d-75b4-4034-b101-e5c1b4699a27
Nov 07 02:40:06 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:06 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c2842842-151d-40a7-a1f3-4ea0f01704d0 tempest-ProjectReaderTests-1071894449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d215070d-75b4-4034-b101-e5c1b4699a27" returned: 0 in 0.261s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c2842842-151d-40a7-a1f3-4ea0f01704d0 tempest-ProjectReaderTests-1071894449 None] Lock "cinder-quobyte-d215070d-75b4-4034-b101-e5c1b4699a27" released by "delete_volume" :: held 0.786s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:06 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b1fb4758-ce87-471b-900e-27ef71da9728 1073741824" returned: 0 in 0.610s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b1fb4758-ce87-471b-900e-27ef71da9728 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-3059747a-1d50-4fa5-84ed-84c730f51e47 req-7269d5ea-ac4c-48cb-afc3-0d9521962ba2 tempest-VolumesGetTestJSON-1054864378 None] Acquiring lock "cinder-453cfbb2-7422-4a32-a9fc-bba55d72f6b7-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:06 devstack sudo[99606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b1fb4758-ce87-471b-900e-27ef71da9728
Nov 07 02:40:06 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-c2842842-151d-40a7-a1f3-4ea0f01704d0 tempest-ProjectReaderTests-1071894449 None] Created reservations ['1291cc01-9a43-4f6d-8d83-e92aa712c982', '805677af-1c78-49e9-aeaa-c836627cb455', '296d5e44-8740-4924-a3e6-9bfc92c902a3', 'fa3800e5-4298-4265-9ed7-21e8665ce965'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-3059747a-1d50-4fa5-84ed-84c730f51e47 req-7269d5ea-ac4c-48cb-afc3-0d9521962ba2 tempest-VolumesGetTestJSON-1054864378 None] Lock "cinder-453cfbb2-7422-4a32-a9fc-bba55d72f6b7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-3059747a-1d50-4fa5-84ed-84c730f51e47 req-7269d5ea-ac4c-48cb-afc3-0d9521962ba2 tempest-VolumesGetTestJSON-1054864378 None] Acquiring lock "cinder-quobyte-453cfbb2-7422-4a32-a9fc-bba55d72f6b7" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-3059747a-1d50-4fa5-84ed-84c730f51e47 req-7269d5ea-ac4c-48cb-afc3-0d9521962ba2 tempest-VolumesGetTestJSON-1054864378 None] Lock "cinder-quobyte-453cfbb2-7422-4a32-a9fc-bba55d72f6b7" acquired by "delete_volume" :: waited 0.037s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c2842842-151d-40a7-a1f3-4ea0f01704d0 tempest-ProjectReaderTests-1071894449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c2842842-151d-40a7-a1f3-4ea0f01704d0 tempest-ProjectReaderTests-1071894449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c2842842-151d-40a7-a1f3-4ea0f01704d0 tempest-ProjectReaderTests-1071894449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c2842842-151d-40a7-a1f3-4ea0f01704d0 tempest-ProjectReaderTests-1071894449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c2842842-151d-40a7-a1f3-4ea0f01704d0 tempest-ProjectReaderTests-1071894449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c2842842-151d-40a7-a1f3-4ea0f01704d0 tempest-ProjectReaderTests-1071894449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95b4278-7f0c-49c9-8880-1ae4b241296b]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-3059747a-1d50-4fa5-84ed-84c730f51e47 req-7269d5ea-ac4c-48cb-afc3-0d9521962ba2 tempest-VolumesGetTestJSON-1054864378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-453cfbb2-7422-4a32-a9fc-bba55d72f6b7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:06 devstack sudo[99608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:40:06 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:06 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b1fb4758-ce87-471b-900e-27ef71da9728" returned: 0 in 0.480s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:06 devstack sudo[99609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-453cfbb2-7422-4a32-a9fc-bba55d72f6b7
Nov 07 02:40:06 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988badf7-b754-4560-82f4-49f62abe2c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1fb4758-ce87-471b-900e-27ef71da9728', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c540eff0-cba9-47e6-a2be-e88f2f0735f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:06 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Volume volume-b1fb4758-ce87-471b-900e-27ef71da9728 (b1fb4758-ce87-471b-900e-27ef71da9728): created successfully
Nov 07 02:40:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c540eff0-cba9-47e6-a2be-e88f2f0735f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Flow 'volume_create_manager' (9d7007fd-c716-48e5-bedf-0ce02287a5f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:07 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-9f6d1155-78ef-478f-97a7-27a32afb6cf4 tempest-VolumesTransfersTest-551668656 None] Created volume successfully.
Nov 07 02:40:07 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c2842842-151d-40a7-a1f3-4ea0f01704d0 tempest-ProjectReaderTests-1071894449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.332s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-c2842842-151d-40a7-a1f3-4ea0f01704d0 tempest-ProjectReaderTests-1071894449 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:40:07 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c2842842-151d-40a7-a1f3-4ea0f01704d0 tempest-ProjectReaderTests-1071894449 None] Deleted volume successfully.
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c2842842-151d-40a7-a1f3-4ea0f01704d0 tempest-ProjectReaderTests-1071894449 None] Lock "cinder-d215070d-75b4-4034-b101-e5c1b4699a27-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:07 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-3059747a-1d50-4fa5-84ed-84c730f51e47 req-7269d5ea-ac4c-48cb-afc3-0d9521962ba2 tempest-VolumesGetTestJSON-1054864378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-453cfbb2-7422-4a32-a9fc-bba55d72f6b7" returned: 0 in 0.629s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-3059747a-1d50-4fa5-84ed-84c730f51e47 req-7269d5ea-ac4c-48cb-afc3-0d9521962ba2 tempest-VolumesGetTestJSON-1054864378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-453cfbb2-7422-4a32-a9fc-bba55d72f6b7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:07 devstack sudo[99618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-453cfbb2-7422-4a32-a9fc-bba55d72f6b7
Nov 07 02:40:07 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Flow 'volume_create_manager' (3b6e16ab-28ac-4d67-81f9-7133f0fddebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6156ac5b-5c4b-4953-a6ba-239eb0c20aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6156ac5b-5c4b-4953-a6ba-239eb0c20aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1580477679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a232f271-83cd-47ce-994a-27d3ed410f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2312ec855341da8e343975732104d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:07Z,use_quota=True,user_id='be426c337cdd40da8cf4593850cd64e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5163e394-c5e0-422a-a51a-fb0c78327ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5163e394-c5e0-422a-a51a-fb0c78327ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3234a9af-7454-4dcf-a7aa-736102a96117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3234a9af-7454-4dcf-a7aa-736102a96117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a232f271-83cd-47ce-994a-27d3ed410f3b', 'volume_name': 'volume-a232f271-83cd-47ce-994a-27d3ed410f3b', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4327b9e6-1cab-46cf-9901-999b33532b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4327b9e6-1cab-46cf-9901-999b33532b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4f3f3b-75b6-4c32-995f-4445a6b39ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:07 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Volume a232f271-83cd-47ce-994a-27d3ed410f3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a232f271-83cd-47ce-994a-27d3ed410f3b', 'volume_size': 1}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1580477679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a232f271-83cd-47ce-994a-27d3ed410f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2312ec855341da8e343975732104d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:07Z,use_quota=True,user_id='be426c337cdd40da8cf4593850cd64e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Creating volume a232f271-83cd-47ce-994a-27d3ed410f3b {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:40:07 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a232f271-83cd-47ce-994a-27d3ed410f3b 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:07 devstack sudo[99620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a232f271-83cd-47ce-994a-27d3ed410f3b 1073741824
Nov 07 02:40:07 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:07 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-3059747a-1d50-4fa5-84ed-84c730f51e47 req-7269d5ea-ac4c-48cb-afc3-0d9521962ba2 tempest-VolumesGetTestJSON-1054864378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-453cfbb2-7422-4a32-a9fc-bba55d72f6b7" returned: 0 in 0.297s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-3059747a-1d50-4fa5-84ed-84c730f51e47 req-7269d5ea-ac4c-48cb-afc3-0d9521962ba2 tempest-VolumesGetTestJSON-1054864378 None] Lock "cinder-quobyte-453cfbb2-7422-4a32-a9fc-bba55d72f6b7" released by "delete_volume" :: held 1.018s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG cinder.quota [req-3059747a-1d50-4fa5-84ed-84c730f51e47 req-7269d5ea-ac4c-48cb-afc3-0d9521962ba2 tempest-VolumesGetTestJSON-1054864378 None] Created reservations ['915e0ece-eb37-49cb-a024-0b843431b5b4', '9f1c7997-ef8a-4d33-bdb9-c3083daa0227', '3cdad192-7458-4f1f-8fed-2aa7b9721831', '5c685959-9acb-4f4a-830c-2461cd5c8071'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-3059747a-1d50-4fa5-84ed-84c730f51e47 req-7269d5ea-ac4c-48cb-afc3-0d9521962ba2 tempest-VolumesGetTestJSON-1054864378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-3059747a-1d50-4fa5-84ed-84c730f51e47 req-7269d5ea-ac4c-48cb-afc3-0d9521962ba2 tempest-VolumesGetTestJSON-1054864378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [req-3059747a-1d50-4fa5-84ed-84c730f51e47 req-7269d5ea-ac4c-48cb-afc3-0d9521962ba2 tempest-VolumesGetTestJSON-1054864378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [req-3059747a-1d50-4fa5-84ed-84c730f51e47 req-7269d5ea-ac4c-48cb-afc3-0d9521962ba2 tempest-VolumesGetTestJSON-1054864378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-3059747a-1d50-4fa5-84ed-84c730f51e47 req-7269d5ea-ac4c-48cb-afc3-0d9521962ba2 tempest-VolumesGetTestJSON-1054864378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-3059747a-1d50-4fa5-84ed-84c730f51e47 req-7269d5ea-ac4c-48cb-afc3-0d9521962ba2 tempest-VolumesGetTestJSON-1054864378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:07 devstack sudo[99626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:40:07 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:08 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-3059747a-1d50-4fa5-84ed-84c730f51e47 req-7269d5ea-ac4c-48cb-afc3-0d9521962ba2 tempest-VolumesGetTestJSON-1054864378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.343s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:08 devstack cinder-volume[87054]: DEBUG cinder.manager [req-3059747a-1d50-4fa5-84ed-84c730f51e47 req-7269d5ea-ac4c-48cb-afc3-0d9521962ba2 tempest-VolumesGetTestJSON-1054864378 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:40:08 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-3059747a-1d50-4fa5-84ed-84c730f51e47 req-7269d5ea-ac4c-48cb-afc3-0d9521962ba2 tempest-VolumesGetTestJSON-1054864378 None] Deleted volume successfully.
Nov 07 02:40:08 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a232f271-83cd-47ce-994a-27d3ed410f3b 1073741824" returned: 0 in 0.722s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-3059747a-1d50-4fa5-84ed-84c730f51e47 req-7269d5ea-ac4c-48cb-afc3-0d9521962ba2 tempest-VolumesGetTestJSON-1054864378 None] Lock "cinder-453cfbb2-7422-4a32-a9fc-bba55d72f6b7-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a232f271-83cd-47ce-994a-27d3ed410f3b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:08 devstack sudo[99631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a232f271-83cd-47ce-994a-27d3ed410f3b
Nov 07 02:40:08 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:08 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-356e2af3-e11f-4e44-88e1-cb93fb3cbf11 tempest-VolumesTransfersTest-978101299 None] Transfer volume completed successfully.
Nov 07 02:40:08 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a232f271-83cd-47ce-994a-27d3ed410f3b" returned: 0 in 0.290s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:40:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4f3f3b-75b6-4c32-995f-4445a6b39ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a232f271-83cd-47ce-994a-27d3ed410f3b', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b4c646-0a9f-435d-900d-987cba9560e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:08 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Volume volume-a232f271-83cd-47ce-994a-27d3ed410f3b (a232f271-83cd-47ce-994a-27d3ed410f3b): created successfully
Nov 07 02:40:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b4c646-0a9f-435d-900d-987cba9560e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Flow 'volume_create_manager' (3b6e16ab-28ac-4d67-81f9-7133f0fddebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:08 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-e69d5667-b8a8-41f6-83c2-4c60ade4e185 tempest-ProjectReaderTests-1071894449 None] Created volume successfully.
Nov 07 02:40:09 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9845024d-9656-46b4-8e91-110b51f7818d tempest-VolumesTransfersTest-552567097 None] Acquiring lock "cinder-b1fb4758-ce87-471b-900e-27ef71da9728-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:09 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9845024d-9656-46b4-8e91-110b51f7818d tempest-VolumesTransfersTest-552567097 None] Lock "cinder-b1fb4758-ce87-471b-900e-27ef71da9728-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:09 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9845024d-9656-46b4-8e91-110b51f7818d tempest-VolumesTransfersTest-552567097 None] Acquiring lock "cinder-quobyte-b1fb4758-ce87-471b-900e-27ef71da9728" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:09 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9845024d-9656-46b4-8e91-110b51f7818d tempest-VolumesTransfersTest-552567097 None] Lock "cinder-quobyte-b1fb4758-ce87-471b-900e-27ef71da9728" acquired by "delete_volume" :: waited 0.019s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:09 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[1406d126-5b20-443c-b080-b90131189821]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9845024d-9656-46b4-8e91-110b51f7818d tempest-VolumesTransfersTest-552567097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b1fb4758-ce87-471b-900e-27ef71da9728 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:09 devstack sudo[99634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b1fb4758-ce87-471b-900e-27ef71da9728
Nov 07 02:40:09 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:09 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-77190df5-de07-422a-9ebd-92de37b7ffe9 tempest-ProjectReaderTests-1071894449 None] Acquiring lock "cinder-a232f271-83cd-47ce-994a-27d3ed410f3b-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:09 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-77190df5-de07-422a-9ebd-92de37b7ffe9 tempest-ProjectReaderTests-1071894449 None] Lock "cinder-a232f271-83cd-47ce-994a-27d3ed410f3b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:09 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-77190df5-de07-422a-9ebd-92de37b7ffe9 tempest-ProjectReaderTests-1071894449 None] Acquiring lock "cinder-quobyte-a232f271-83cd-47ce-994a-27d3ed410f3b" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:09 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9845024d-9656-46b4-8e91-110b51f7818d tempest-VolumesTransfersTest-552567097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b1fb4758-ce87-471b-900e-27ef71da9728" returned: 0 in 0.474s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9845024d-9656-46b4-8e91-110b51f7818d tempest-VolumesTransfersTest-552567097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b1fb4758-ce87-471b-900e-27ef71da9728 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:09 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-77190df5-de07-422a-9ebd-92de37b7ffe9 tempest-ProjectReaderTests-1071894449 None] Lock "cinder-quobyte-a232f271-83cd-47ce-994a-27d3ed410f3b" acquired by "delete_volume" :: waited 0.029s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:09 devstack sudo[99639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b1fb4758-ce87-471b-900e-27ef71da9728
Nov 07 02:40:09 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:09 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec40d62-1183-47b0-9935-c0c31df6abcb]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-77190df5-de07-422a-9ebd-92de37b7ffe9 tempest-ProjectReaderTests-1071894449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a232f271-83cd-47ce-994a-27d3ed410f3b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:09 devstack sudo[99641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a232f271-83cd-47ce-994a-27d3ed410f3b
Nov 07 02:40:09 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:10 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9845024d-9656-46b4-8e91-110b51f7818d tempest-VolumesTransfersTest-552567097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b1fb4758-ce87-471b-900e-27ef71da9728" returned: 0 in 0.332s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:10 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9845024d-9656-46b4-8e91-110b51f7818d tempest-VolumesTransfersTest-552567097 None] Lock "cinder-quobyte-b1fb4758-ce87-471b-900e-27ef71da9728" released by "delete_volume" :: held 0.876s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:10 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-9845024d-9656-46b4-8e91-110b51f7818d tempest-VolumesTransfersTest-552567097 None] Created reservations ['40fa572d-ade6-4b02-9ad5-3ab6eeaa9f35', '7f13ca99-fc80-4b44-9509-56f57825c4db', '1a0213a9-9f41-4fa1-97fd-a65df8fa84c6', '938c3398-8f18-47ea-9780-0cc780f25796'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:40:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9845024d-9656-46b4-8e91-110b51f7818d tempest-VolumesTransfersTest-552567097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9845024d-9656-46b4-8e91-110b51f7818d tempest-VolumesTransfersTest-552567097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:10 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9845024d-9656-46b4-8e91-110b51f7818d tempest-VolumesTransfersTest-552567097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:10 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9845024d-9656-46b4-8e91-110b51f7818d tempest-VolumesTransfersTest-552567097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9845024d-9656-46b4-8e91-110b51f7818d tempest-VolumesTransfersTest-552567097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9845024d-9656-46b4-8e91-110b51f7818d tempest-VolumesTransfersTest-552567097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:10 devstack sudo[99647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:40:10 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:10 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-77190df5-de07-422a-9ebd-92de37b7ffe9 tempest-ProjectReaderTests-1071894449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a232f271-83cd-47ce-994a-27d3ed410f3b" returned: 0 in 0.612s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-77190df5-de07-422a-9ebd-92de37b7ffe9 tempest-ProjectReaderTests-1071894449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a232f271-83cd-47ce-994a-27d3ed410f3b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:10 devstack sudo[99649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a232f271-83cd-47ce-994a-27d3ed410f3b
Nov 07 02:40:10 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:10 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9845024d-9656-46b4-8e91-110b51f7818d tempest-VolumesTransfersTest-552567097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.377s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:10 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-9845024d-9656-46b4-8e91-110b51f7818d tempest-VolumesTransfersTest-552567097 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:40:10 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-9845024d-9656-46b4-8e91-110b51f7818d tempest-VolumesTransfersTest-552567097 None] Deleted volume successfully.
Nov 07 02:40:10 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9845024d-9656-46b4-8e91-110b51f7818d tempest-VolumesTransfersTest-552567097 None] Lock "cinder-b1fb4758-ce87-471b-900e-27ef71da9728-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:10 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-77190df5-de07-422a-9ebd-92de37b7ffe9 tempest-ProjectReaderTests-1071894449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a232f271-83cd-47ce-994a-27d3ed410f3b" returned: 0 in 0.386s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:10 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-77190df5-de07-422a-9ebd-92de37b7ffe9 tempest-ProjectReaderTests-1071894449 None] Lock "cinder-quobyte-a232f271-83cd-47ce-994a-27d3ed410f3b" released by "delete_volume" :: held 1.061s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:10 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-77190df5-de07-422a-9ebd-92de37b7ffe9 tempest-ProjectReaderTests-1071894449 None] Created reservations ['9bace7d2-51ff-48b9-afc4-030cdf7f6cea', '7caa5352-5e80-45c3-8a79-d1d45bca6524', 'a2a57291-f0c2-4aa4-8aa2-2b0c7e1f86bd', '6f949103-ea7c-479b-980c-dad20c7cb651'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-77190df5-de07-422a-9ebd-92de37b7ffe9 tempest-ProjectReaderTests-1071894449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-77190df5-de07-422a-9ebd-92de37b7ffe9 tempest-ProjectReaderTests-1071894449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-77190df5-de07-422a-9ebd-92de37b7ffe9 tempest-ProjectReaderTests-1071894449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-77190df5-de07-422a-9ebd-92de37b7ffe9 tempest-ProjectReaderTests-1071894449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-77190df5-de07-422a-9ebd-92de37b7ffe9 tempest-ProjectReaderTests-1071894449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-77190df5-de07-422a-9ebd-92de37b7ffe9 tempest-ProjectReaderTests-1071894449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:11 devstack sudo[99654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:40:11 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Flow 'volume_create_manager' (325ac79c-2f4e-4080-a44b-ae966ac5ea97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bc4c7f-0e50-4f1c-95a2-1af69a1fa78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bc4c7f-0e50-4f1c-95a2-1af69a1fa78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-918965717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aead566b-4624-465a-b9fe-6657e68fa4a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e06c7a41204045a89934d98ac2b89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:11Z,use_quota=True,user_id='9fbbd31dd3d145408a63f448d270ed9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca2e2bf6-5dad-4aee-b799-891e1dd45695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca2e2bf6-5dad-4aee-b799-891e1dd45695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f923ede-5fcc-4887-94ef-cfb2556c1332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f923ede-5fcc-4887-94ef-cfb2556c1332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aead566b-4624-465a-b9fe-6657e68fa4a1', 'volume_name': 'volume-aead566b-4624-465a-b9fe-6657e68fa4a1', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86c62d6-cbd9-497d-a0be-01dc7e3f7b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86c62d6-cbd9-497d-a0be-01dc7e3f7b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c252e438-6782-4a69-ac12-64658977bd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:11 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Volume aead566b-4624-465a-b9fe-6657e68fa4a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aead566b-4624-465a-b9fe-6657e68fa4a1', 'volume_size': 1}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-918965717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aead566b-4624-465a-b9fe-6657e68fa4a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e06c7a41204045a89934d98ac2b89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:11Z,use_quota=True,user_id='9fbbd31dd3d145408a63f448d270ed9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Creating volume aead566b-4624-465a-b9fe-6657e68fa4a1 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:40:11 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aead566b-4624-465a-b9fe-6657e68fa4a1 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:11 devstack sudo[99657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aead566b-4624-465a-b9fe-6657e68fa4a1 1073741824
Nov 07 02:40:11 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:11 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-77190df5-de07-422a-9ebd-92de37b7ffe9 tempest-ProjectReaderTests-1071894449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.386s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-77190df5-de07-422a-9ebd-92de37b7ffe9 tempest-ProjectReaderTests-1071894449 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:40:11 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-77190df5-de07-422a-9ebd-92de37b7ffe9 tempest-ProjectReaderTests-1071894449 None] Deleted volume successfully.
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-77190df5-de07-422a-9ebd-92de37b7ffe9 tempest-ProjectReaderTests-1071894449 None] Lock "cinder-a232f271-83cd-47ce-994a-27d3ed410f3b-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:11 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aead566b-4624-465a-b9fe-6657e68fa4a1 1073741824" returned: 0 in 0.510s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aead566b-4624-465a-b9fe-6657e68fa4a1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:11 devstack sudo[99663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aead566b-4624-465a-b9fe-6657e68fa4a1
Nov 07 02:40:11 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:12 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aead566b-4624-465a-b9fe-6657e68fa4a1" returned: 0 in 0.351s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c252e438-6782-4a69-ac12-64658977bd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aead566b-4624-465a-b9fe-6657e68fa4a1', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e895ab91-6610-499d-8000-fbdcb02105dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:12 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Volume volume-aead566b-4624-465a-b9fe-6657e68fa4a1 (aead566b-4624-465a-b9fe-6657e68fa4a1): created successfully
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e895ab91-6610-499d-8000-fbdcb02105dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Flow 'volume_create_manager' (325ac79c-2f4e-4080-a44b-ae966ac5ea97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:12 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-e5d2989e-7c4b-4783-a207-324c9aa96e1f tempest-VolumesTransfersTest-551668656 None] Created volume successfully.
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Flow 'volume_create_manager' (7c76239d-1d40-4cf2-abcb-0a2c17d4cca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7721ef2-6d2d-465f-bea0-eaca43769f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7721ef2-6d2d-465f-bea0-eaca43769f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2097007517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c5e6bfd-ee17-4a6b-8848-296927502182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2312ec855341da8e343975732104d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:13Z,use_quota=True,user_id='be426c337cdd40da8cf4593850cd64e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb55660-ea6f-4e17-9431-d489ae4d51a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb55660-ea6f-4e17-9431-d489ae4d51a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f59ca41a-873c-4bb7-827f-efe749933984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f59ca41a-873c-4bb7-827f-efe749933984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c5e6bfd-ee17-4a6b-8848-296927502182', 'volume_name': 'volume-2c5e6bfd-ee17-4a6b-8848-296927502182', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2564e769-c948-47d2-87ec-342e85b7bdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2564e769-c948-47d2-87ec-342e85b7bdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190b28ae-5ad8-428d-a842-cc63a400cb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:12 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Volume 2c5e6bfd-ee17-4a6b-8848-296927502182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c5e6bfd-ee17-4a6b-8848-296927502182', 'volume_size': 1}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2097007517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c5e6bfd-ee17-4a6b-8848-296927502182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2312ec855341da8e343975732104d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:13Z,use_quota=True,user_id='be426c337cdd40da8cf4593850cd64e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Creating volume 2c5e6bfd-ee17-4a6b-8848-296927502182 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:40:12 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:40:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2c5e6bfd-ee17-4a6b-8848-296927502182 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:12 devstack sudo[99669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2c5e6bfd-ee17-4a6b-8848-296927502182 1073741824
Nov 07 02:40:12 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:13 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2c5e6bfd-ee17-4a6b-8848-296927502182 1073741824" returned: 0 in 0.740s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2c5e6bfd-ee17-4a6b-8848-296927502182 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:13 devstack sudo[99675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2c5e6bfd-ee17-4a6b-8848-296927502182
Nov 07 02:40:13 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:13 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-06e11f59-271a-4a2a-b5de-7037310c2263 tempest-VolumesTransfersTest-552567097 None] Acquiring lock "cinder-aead566b-4624-465a-b9fe-6657e68fa4a1-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:13 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-06e11f59-271a-4a2a-b5de-7037310c2263 tempest-VolumesTransfersTest-552567097 None] Lock "cinder-aead566b-4624-465a-b9fe-6657e68fa4a1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:13 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-06e11f59-271a-4a2a-b5de-7037310c2263 tempest-VolumesTransfersTest-552567097 None] Acquiring lock "cinder-quobyte-aead566b-4624-465a-b9fe-6657e68fa4a1" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:13 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-06e11f59-271a-4a2a-b5de-7037310c2263 tempest-VolumesTransfersTest-552567097 None] Lock "cinder-quobyte-aead566b-4624-465a-b9fe-6657e68fa4a1" acquired by "delete_volume" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:13 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2014bca-0239-4603-a150-77cb4b9e94a4]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-06e11f59-271a-4a2a-b5de-7037310c2263 tempest-VolumesTransfersTest-552567097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aead566b-4624-465a-b9fe-6657e68fa4a1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:13 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2c5e6bfd-ee17-4a6b-8848-296927502182" returned: 0 in 0.364s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:40:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190b28ae-5ad8-428d-a842-cc63a400cb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c5e6bfd-ee17-4a6b-8848-296927502182', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521a893d-9f85-4799-a315-a8520f0dfd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:14 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Volume volume-2c5e6bfd-ee17-4a6b-8848-296927502182 (2c5e6bfd-ee17-4a6b-8848-296927502182): created successfully
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521a893d-9f85-4799-a315-a8520f0dfd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Flow 'volume_create_manager' (7c76239d-1d40-4cf2-abcb-0a2c17d4cca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:14 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-9c64922e-1908-496e-941f-87b38e9a2f5b tempest-ProjectReaderTests-1071894449 None] Created volume successfully.
Nov 07 02:40:14 devstack sudo[99702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aead566b-4624-465a-b9fe-6657e68fa4a1
Nov 07 02:40:14 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Flow 'volume_create_manager' (1b7785d8-40fd-4e78-a4df-7b07be3c1099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d61730-2f3c-4bb7-a8fc-443ab7e283ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d61730-2f3c-4bb7-a8fc-443ab7e283ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1728083204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52837b16-17d9-4453-b58e-796c98a1545a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d790f49f4bf4f1e9bc5ccd1db2f8635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:14Z,use_quota=True,user_id='fd58b8bb1fea46639ffb242743e26ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49647bec-43ba-41b5-a762-87d8b463f673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49647bec-43ba-41b5-a762-87d8b463f673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (169bae17-3769-4660-b83a-44c8f94b54c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:14 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (169bae17-3769-4660-b83a-44c8f94b54c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52837b16-17d9-4453-b58e-796c98a1545a', 'volume_name': 'volume-52837b16-17d9-4453-b58e-796c98a1545a', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90de453-7ec2-4cba-921c-f7e40e3b5da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90de453-7ec2-4cba-921c-f7e40e3b5da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5cfd0c0-02f4-4e9c-8629-1e55518186b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:14 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Volume 52837b16-17d9-4453-b58e-796c98a1545a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52837b16-17d9-4453-b58e-796c98a1545a', 'volume_size': 1}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1728083204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52837b16-17d9-4453-b58e-796c98a1545a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d790f49f4bf4f1e9bc5ccd1db2f8635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:14Z,use_quota=True,user_id='fd58b8bb1fea46639ffb242743e26ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Creating volume 52837b16-17d9-4453-b58e-796c98a1545a {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:40:14 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-52837b16-17d9-4453-b58e-796c98a1545a 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-06e11f59-271a-4a2a-b5de-7037310c2263 tempest-VolumesTransfersTest-552567097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aead566b-4624-465a-b9fe-6657e68fa4a1" returned: 0 in 0.603s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-06e11f59-271a-4a2a-b5de-7037310c2263 tempest-VolumesTransfersTest-552567097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aead566b-4624-465a-b9fe-6657e68fa4a1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:14 devstack sudo[99725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-52837b16-17d9-4453-b58e-796c98a1545a 1073741824
Nov 07 02:40:14 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:14 devstack sudo[99726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aead566b-4624-465a-b9fe-6657e68fa4a1
Nov 07 02:40:14 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-29054d0f-e819-4689-a1f5-6f260b5b8b76 tempest-ProjectReaderTests-1071894449 None] Acquiring lock "cinder-2c5e6bfd-ee17-4a6b-8848-296927502182-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:14 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-06e11f59-271a-4a2a-b5de-7037310c2263 tempest-VolumesTransfersTest-552567097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aead566b-4624-465a-b9fe-6657e68fa4a1" returned: 0 in 0.324s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-29054d0f-e819-4689-a1f5-6f260b5b8b76 tempest-ProjectReaderTests-1071894449 None] Lock "cinder-2c5e6bfd-ee17-4a6b-8848-296927502182-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-06e11f59-271a-4a2a-b5de-7037310c2263 tempest-VolumesTransfersTest-552567097 None] Lock "cinder-quobyte-aead566b-4624-465a-b9fe-6657e68fa4a1" released by "delete_volume" :: held 1.013s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-29054d0f-e819-4689-a1f5-6f260b5b8b76 tempest-ProjectReaderTests-1071894449 None] Acquiring lock "cinder-quobyte-2c5e6bfd-ee17-4a6b-8848-296927502182" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-29054d0f-e819-4689-a1f5-6f260b5b8b76 tempest-ProjectReaderTests-1071894449 None] Lock "cinder-quobyte-2c5e6bfd-ee17-4a6b-8848-296927502182" acquired by "delete_volume" :: waited 0.021s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-06e11f59-271a-4a2a-b5de-7037310c2263 tempest-VolumesTransfersTest-552567097 None] Created reservations ['07138fa8-8206-4235-98ea-0b4f7d5dd59b', 'cbdf39b0-4c1d-4c1d-85d3-edaef7a074b0', '54b6f205-2d58-47d7-a7bb-575ff0736cb2', '018dfad9-683a-48bf-b3e4-e60a6fd7e619'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abff3a8-a364-4163-884e-61c69aabaf02]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-29054d0f-e819-4689-a1f5-6f260b5b8b76 tempest-ProjectReaderTests-1071894449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2c5e6bfd-ee17-4a6b-8848-296927502182 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-06e11f59-271a-4a2a-b5de-7037310c2263 tempest-VolumesTransfersTest-552567097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-06e11f59-271a-4a2a-b5de-7037310c2263 tempest-VolumesTransfersTest-552567097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-06e11f59-271a-4a2a-b5de-7037310c2263 tempest-VolumesTransfersTest-552567097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-06e11f59-271a-4a2a-b5de-7037310c2263 tempest-VolumesTransfersTest-552567097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-06e11f59-271a-4a2a-b5de-7037310c2263 tempest-VolumesTransfersTest-552567097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-06e11f59-271a-4a2a-b5de-7037310c2263 tempest-VolumesTransfersTest-552567097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:15 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-52837b16-17d9-4453-b58e-796c98a1545a 1073741824" returned: 0 in 0.579s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:15 devstack sudo[99735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:40:15 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:15 devstack sudo[99734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2c5e6bfd-ee17-4a6b-8848-296927502182
Nov 07 02:40:15 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-52837b16-17d9-4453-b58e-796c98a1545a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:15 devstack sudo[99738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-52837b16-17d9-4453-b58e-796c98a1545a
Nov 07 02:40:15 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:15 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-06e11f59-271a-4a2a-b5de-7037310c2263 tempest-VolumesTransfersTest-552567097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.313s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-06e11f59-271a-4a2a-b5de-7037310c2263 tempest-VolumesTransfersTest-552567097 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:40:15 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:15 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-06e11f59-271a-4a2a-b5de-7037310c2263 tempest-VolumesTransfersTest-552567097 None] Deleted volume successfully.
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-29054d0f-e819-4689-a1f5-6f260b5b8b76 tempest-ProjectReaderTests-1071894449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2c5e6bfd-ee17-4a6b-8848-296927502182" returned: 0 in 0.417s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-29054d0f-e819-4689-a1f5-6f260b5b8b76 tempest-ProjectReaderTests-1071894449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2c5e6bfd-ee17-4a6b-8848-296927502182 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:15 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-52837b16-17d9-4453-b58e-796c98a1545a" returned: 0 in 0.293s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:15 devstack sudo[99745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2c5e6bfd-ee17-4a6b-8848-296927502182
Nov 07 02:40:15 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5cfd0c0-02f4-4e9c-8629-1e55518186b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52837b16-17d9-4453-b58e-796c98a1545a', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c62a6c-4540-4246-b359-9ff4f85509d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-06e11f59-271a-4a2a-b5de-7037310c2263 tempest-VolumesTransfersTest-552567097 None] Lock "cinder-aead566b-4624-465a-b9fe-6657e68fa4a1-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:15 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Volume volume-52837b16-17d9-4453-b58e-796c98a1545a (52837b16-17d9-4453-b58e-796c98a1545a): created successfully
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c62a6c-4540-4246-b359-9ff4f85509d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Flow 'volume_create_manager' (1b7785d8-40fd-4e78-a4df-7b07be3c1099) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:15 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f2bff97f-c68b-41c9-9835-0aed1958203c tempest-VolumesTestJSON-278870397 None] Created volume successfully.
Nov 07 02:40:15 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-29054d0f-e819-4689-a1f5-6f260b5b8b76 tempest-ProjectReaderTests-1071894449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2c5e6bfd-ee17-4a6b-8848-296927502182" returned: 0 in 0.273s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-29054d0f-e819-4689-a1f5-6f260b5b8b76 tempest-ProjectReaderTests-1071894449 None] Lock "cinder-quobyte-2c5e6bfd-ee17-4a6b-8848-296927502182" released by "delete_volume" :: held 0.743s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-29054d0f-e819-4689-a1f5-6f260b5b8b76 tempest-ProjectReaderTests-1071894449 None] Created reservations ['1b386b07-24ff-4524-a66c-deaed4b7b438', '679d99f9-f9fc-40d2-92dc-d5c7a900596f', '014a6c19-f98c-4fef-84ac-1ed3932b71fc', '9c648d35-f090-4c00-989d-37b27f45793d'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-29054d0f-e819-4689-a1f5-6f260b5b8b76 tempest-ProjectReaderTests-1071894449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-29054d0f-e819-4689-a1f5-6f260b5b8b76 tempest-ProjectReaderTests-1071894449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-29054d0f-e819-4689-a1f5-6f260b5b8b76 tempest-ProjectReaderTests-1071894449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-29054d0f-e819-4689-a1f5-6f260b5b8b76 tempest-ProjectReaderTests-1071894449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-29054d0f-e819-4689-a1f5-6f260b5b8b76 tempest-ProjectReaderTests-1071894449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-29054d0f-e819-4689-a1f5-6f260b5b8b76 tempest-ProjectReaderTests-1071894449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:15 devstack sudo[99748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:40:15 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:16 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-29054d0f-e819-4689-a1f5-6f260b5b8b76 tempest-ProjectReaderTests-1071894449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.258s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-29054d0f-e819-4689-a1f5-6f260b5b8b76 tempest-ProjectReaderTests-1071894449 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:40:16 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-29054d0f-e819-4689-a1f5-6f260b5b8b76 tempest-ProjectReaderTests-1071894449 None] Deleted volume successfully.
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-29054d0f-e819-4689-a1f5-6f260b5b8b76 tempest-ProjectReaderTests-1071894449 None] Lock "cinder-2c5e6bfd-ee17-4a6b-8848-296927502182-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Flow 'volume_create_manager' (dd6e979d-ad24-461a-887a-6c69caad188b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f6d662-c884-458a-abc5-f31f82915124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f6d662-c884-458a-abc5-f31f82915124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1701992920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0332c020-018e-487e-bedb-ba7b0ab18ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2312ec855341da8e343975732104d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:16Z,use_quota=True,user_id='be426c337cdd40da8cf4593850cd64e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa09c52-63f4-4395-8aad-0630708be561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa09c52-63f4-4395-8aad-0630708be561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ba4113-a8e9-441d-9101-56676e2896dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ba4113-a8e9-441d-9101-56676e2896dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0332c020-018e-487e-bedb-ba7b0ab18ea4', 'volume_name': 'volume-0332c020-018e-487e-bedb-ba7b0ab18ea4', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd9644d-cdfa-418b-b983-1661515c0cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd9644d-cdfa-418b-b983-1661515c0cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7caff2c-7489-4137-b719-656a0ec09981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:16 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Volume 0332c020-018e-487e-bedb-ba7b0ab18ea4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0332c020-018e-487e-bedb-ba7b0ab18ea4', 'volume_size': 1}
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1701992920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0332c020-018e-487e-bedb-ba7b0ab18ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2312ec855341da8e343975732104d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:16Z,use_quota=True,user_id='be426c337cdd40da8cf4593850cd64e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Creating volume 0332c020-018e-487e-bedb-ba7b0ab18ea4 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:40:16 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:40:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0332c020-018e-487e-bedb-ba7b0ab18ea4 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:16 devstack sudo[99753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0332c020-018e-487e-bedb-ba7b0ab18ea4 1073741824
Nov 07 02:40:16 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Flow 'volume_create_manager' (1a8d04b4-68b8-44c1-896a-d4c27e741fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba1005d-8e1c-489f-b6c4-0adb6bbcbe71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba1005d-8e1c-489f-b6c4-0adb6bbcbe71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1593116093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=144a0d28-7980-4507-9895-afe98321a4a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d790f49f4bf4f1e9bc5ccd1db2f8635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:17Z,use_quota=True,user_id='fd58b8bb1fea46639ffb242743e26ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:17 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed2245e-8935-4bdf-80ca-c3bebac90888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed2245e-8935-4bdf-80ca-c3bebac90888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f5c4852-9ff9-492e-b9f1-e08092894057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f5c4852-9ff9-492e-b9f1-e08092894057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '144a0d28-7980-4507-9895-afe98321a4a0', 'volume_name': 'volume-144a0d28-7980-4507-9895-afe98321a4a0', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd6970e4-24b3-4834-b3bd-4016a233832c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd6970e4-24b3-4834-b3bd-4016a233832c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce59f75-26ee-435f-bfe9-78d41adb4f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:17 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Volume 144a0d28-7980-4507-9895-afe98321a4a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-144a0d28-7980-4507-9895-afe98321a4a0', 'volume_size': 1}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0332c020-018e-487e-bedb-ba7b0ab18ea4 1073741824" returned: 0 in 0.606s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0332c020-018e-487e-bedb-ba7b0ab18ea4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:17 devstack sudo[99759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0332c020-018e-487e-bedb-ba7b0ab18ea4
Nov 07 02:40:17 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:17 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0332c020-018e-487e-bedb-ba7b0ab18ea4" returned: 0 in 0.263s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.301s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1593116093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=144a0d28-7980-4507-9895-afe98321a4a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d790f49f4bf4f1e9bc5ccd1db2f8635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:17Z,use_quota=True,user_id='fd58b8bb1fea46639ffb242743e26ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Creating volume 144a0d28-7980-4507-9895-afe98321a4a0 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:40:17 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-144a0d28-7980-4507-9895-afe98321a4a0 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7caff2c-7489-4137-b719-656a0ec09981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0332c020-018e-487e-bedb-ba7b0ab18ea4', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:17 devstack sudo[99762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-144a0d28-7980-4507-9895-afe98321a4a0 1073741824
Nov 07 02:40:17 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (938748e4-4247-4ffe-bfdf-277bef8aa875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:17 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Volume volume-0332c020-018e-487e-bedb-ba7b0ab18ea4 (0332c020-018e-487e-bedb-ba7b0ab18ea4): created successfully
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (938748e4-4247-4ffe-bfdf-277bef8aa875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Flow 'volume_create_manager' (dd6e979d-ad24-461a-887a-6c69caad188b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:17 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-7c325448-7e2a-4324-a8b5-fdee53fe4185 tempest-ProjectReaderTests-1071894449 None] Created volume successfully.
Nov 07 02:40:18 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-144a0d28-7980-4507-9895-afe98321a4a0 1073741824" returned: 0 in 0.525s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-144a0d28-7980-4507-9895-afe98321a4a0 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:18 devstack sudo[99769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-144a0d28-7980-4507-9895-afe98321a4a0
Nov 07 02:40:18 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:18 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-144a0d28-7980-4507-9895-afe98321a4a0" returned: 0 in 0.279s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:18 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:40:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce59f75-26ee-435f-bfe9-78d41adb4f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-144a0d28-7980-4507-9895-afe98321a4a0', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1359f960-bdbb-48d0-a52f-0114153552cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:18 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Volume volume-144a0d28-7980-4507-9895-afe98321a4a0 (144a0d28-7980-4507-9895-afe98321a4a0): created successfully
Nov 07 02:40:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1359f960-bdbb-48d0-a52f-0114153552cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Flow 'volume_create_manager' (1a8d04b4-68b8-44c1-896a-d4c27e741fe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:18 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-2d2ac584-7730-482e-8608-2de015ea63ca tempest-VolumesTestJSON-278870397 None] Created volume successfully.
Nov 07 02:40:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6553e091-b047-4248-a0ec-f9a7c655006c tempest-ProjectReaderTests-1071894449 None] Acquiring lock "cinder-0332c020-018e-487e-bedb-ba7b0ab18ea4-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6553e091-b047-4248-a0ec-f9a7c655006c tempest-ProjectReaderTests-1071894449 None] Lock "cinder-0332c020-018e-487e-bedb-ba7b0ab18ea4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6553e091-b047-4248-a0ec-f9a7c655006c tempest-ProjectReaderTests-1071894449 None] Acquiring lock "cinder-quobyte-0332c020-018e-487e-bedb-ba7b0ab18ea4" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6553e091-b047-4248-a0ec-f9a7c655006c tempest-ProjectReaderTests-1071894449 None] Lock "cinder-quobyte-0332c020-018e-487e-bedb-ba7b0ab18ea4" acquired by "delete_volume" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:18 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f47849-b425-4581-81af-b1674c212c9b]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6553e091-b047-4248-a0ec-f9a7c655006c tempest-ProjectReaderTests-1071894449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0332c020-018e-487e-bedb-ba7b0ab18ea4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:18 devstack sudo[99772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0332c020-018e-487e-bedb-ba7b0ab18ea4
Nov 07 02:40:18 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:19 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6553e091-b047-4248-a0ec-f9a7c655006c tempest-ProjectReaderTests-1071894449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0332c020-018e-487e-bedb-ba7b0ab18ea4" returned: 0 in 0.397s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6553e091-b047-4248-a0ec-f9a7c655006c tempest-ProjectReaderTests-1071894449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0332c020-018e-487e-bedb-ba7b0ab18ea4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:19 devstack sudo[99777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0332c020-018e-487e-bedb-ba7b0ab18ea4
Nov 07 02:40:19 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:19 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6553e091-b047-4248-a0ec-f9a7c655006c tempest-ProjectReaderTests-1071894449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0332c020-018e-487e-bedb-ba7b0ab18ea4" returned: 0 in 0.288s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6553e091-b047-4248-a0ec-f9a7c655006c tempest-ProjectReaderTests-1071894449 None] Lock "cinder-quobyte-0332c020-018e-487e-bedb-ba7b0ab18ea4" released by "delete_volume" :: held 0.748s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:19 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-6553e091-b047-4248-a0ec-f9a7c655006c tempest-ProjectReaderTests-1071894449 None] Created reservations ['ac0161cb-bad9-42d3-86c1-1d9b00e7fe29', 'df981071-277e-42e0-8b49-0e10e3730ce3', '1f1f1788-e16c-47f5-b845-31a7b90e578a', 'b86edf2a-c5b8-4895-aad7-ef26722cb52e'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:40:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6553e091-b047-4248-a0ec-f9a7c655006c tempest-ProjectReaderTests-1071894449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6553e091-b047-4248-a0ec-f9a7c655006c tempest-ProjectReaderTests-1071894449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6553e091-b047-4248-a0ec-f9a7c655006c tempest-ProjectReaderTests-1071894449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6553e091-b047-4248-a0ec-f9a7c655006c tempest-ProjectReaderTests-1071894449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6553e091-b047-4248-a0ec-f9a7c655006c tempest-ProjectReaderTests-1071894449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6553e091-b047-4248-a0ec-f9a7c655006c tempest-ProjectReaderTests-1071894449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:19 devstack sudo[99780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:40:19 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:19 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6553e091-b047-4248-a0ec-f9a7c655006c tempest-ProjectReaderTests-1071894449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.351s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:19 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6553e091-b047-4248-a0ec-f9a7c655006c tempest-ProjectReaderTests-1071894449 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:40:19 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-6553e091-b047-4248-a0ec-f9a7c655006c tempest-ProjectReaderTests-1071894449 None] Deleted volume successfully.
Nov 07 02:40:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6553e091-b047-4248-a0ec-f9a7c655006c tempest-ProjectReaderTests-1071894449 None] Lock "cinder-0332c020-018e-487e-bedb-ba7b0ab18ea4-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:20 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:40:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Flow 'volume_create_manager' (9ad513c8-25c0-4337-971b-41aefb34853a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba0110cb-2ef4-4aaf-907c-d131957d3ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba0110cb-2ef4-4aaf-907c-d131957d3ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1546774586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bece0fb-da88-4f1f-bb5f-b96cc245bdd6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d790f49f4bf4f1e9bc5ccd1db2f8635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:20Z,use_quota=True,user_id='fd58b8bb1fea46639ffb242743e26ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cab2a8f-42a1-46bd-ada5-c422073a326a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cab2a8f-42a1-46bd-ada5-c422073a326a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a66ea6e-a789-4447-949f-35384514e8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a66ea6e-a789-4447-949f-35384514e8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bece0fb-da88-4f1f-bb5f-b96cc245bdd6', 'volume_name': 'volume-6bece0fb-da88-4f1f-bb5f-b96cc245bdd6', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f8a477-0888-4aa1-90c1-9e778dc90971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f8a477-0888-4aa1-90c1-9e778dc90971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51eb20ec-4447-4e5b-8946-4c2d8ba7a952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:20 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Volume 6bece0fb-da88-4f1f-bb5f-b96cc245bdd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bece0fb-da88-4f1f-bb5f-b96cc245bdd6', 'volume_size': 1}
Nov 07 02:40:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1546774586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bece0fb-da88-4f1f-bb5f-b96cc245bdd6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d790f49f4bf4f1e9bc5ccd1db2f8635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:20Z,use_quota=True,user_id='fd58b8bb1fea46639ffb242743e26ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:40:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Creating volume 6bece0fb-da88-4f1f-bb5f-b96cc245bdd6 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:40:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:40:20 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:40:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6bece0fb-da88-4f1f-bb5f-b96cc245bdd6 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:20 devstack sudo[99783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6bece0fb-da88-4f1f-bb5f-b96cc245bdd6 1073741824
Nov 07 02:40:20 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:20 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6bece0fb-da88-4f1f-bb5f-b96cc245bdd6 1073741824" returned: 0 in 0.628s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6bece0fb-da88-4f1f-bb5f-b96cc245bdd6 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:21 devstack sudo[99788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6bece0fb-da88-4f1f-bb5f-b96cc245bdd6
Nov 07 02:40:21 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:21 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6bece0fb-da88-4f1f-bb5f-b96cc245bdd6" returned: 0 in 0.420s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:21 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:40:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:21 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51eb20ec-4447-4e5b-8946-4c2d8ba7a952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bece0fb-da88-4f1f-bb5f-b96cc245bdd6', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:21 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d45b083-697e-4a03-9e08-130d63634980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:21 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Volume volume-6bece0fb-da88-4f1f-bb5f-b96cc245bdd6 (6bece0fb-da88-4f1f-bb5f-b96cc245bdd6): created successfully
Nov 07 02:40:21 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d45b083-697e-4a03-9e08-130d63634980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:21 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Flow 'volume_create_manager' (9ad513c8-25c0-4337-971b-41aefb34853a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:21 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-d76d547a-bcd4-4f50-a465-bdcb7e8de132 tempest-VolumesTestJSON-278870397 None] Created volume successfully.
Nov 07 02:40:23 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-89d44b7d-6259-4b57-b68c-6fc837a4e42d tempest-VolumesTestJSON-278870397 None] Acquiring lock "cinder-6bece0fb-da88-4f1f-bb5f-b96cc245bdd6-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:23 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-89d44b7d-6259-4b57-b68c-6fc837a4e42d tempest-VolumesTestJSON-278870397 None] Lock "cinder-6bece0fb-da88-4f1f-bb5f-b96cc245bdd6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:23 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-89d44b7d-6259-4b57-b68c-6fc837a4e42d tempest-VolumesTestJSON-278870397 None] Acquiring lock "cinder-quobyte-6bece0fb-da88-4f1f-bb5f-b96cc245bdd6" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:23 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-89d44b7d-6259-4b57-b68c-6fc837a4e42d tempest-VolumesTestJSON-278870397 None] Lock "cinder-quobyte-6bece0fb-da88-4f1f-bb5f-b96cc245bdd6" acquired by "delete_volume" :: waited 0.019s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:23 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce19112c-7e48-44f5-ab5b-4ccb92aff576]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-89d44b7d-6259-4b57-b68c-6fc837a4e42d tempest-VolumesTestJSON-278870397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6bece0fb-da88-4f1f-bb5f-b96cc245bdd6 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:24 devstack sudo[99808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6bece0fb-da88-4f1f-bb5f-b96cc245bdd6
Nov 07 02:40:24 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:24 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-89d44b7d-6259-4b57-b68c-6fc837a4e42d tempest-VolumesTestJSON-278870397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6bece0fb-da88-4f1f-bb5f-b96cc245bdd6" returned: 0 in 0.404s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-89d44b7d-6259-4b57-b68c-6fc837a4e42d tempest-VolumesTestJSON-278870397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6bece0fb-da88-4f1f-bb5f-b96cc245bdd6 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:24 devstack sudo[99814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6bece0fb-da88-4f1f-bb5f-b96cc245bdd6
Nov 07 02:40:24 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:24 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-89d44b7d-6259-4b57-b68c-6fc837a4e42d tempest-VolumesTestJSON-278870397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6bece0fb-da88-4f1f-bb5f-b96cc245bdd6" returned: 0 in 0.276s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-89d44b7d-6259-4b57-b68c-6fc837a4e42d tempest-VolumesTestJSON-278870397 None] Lock "cinder-quobyte-6bece0fb-da88-4f1f-bb5f-b96cc245bdd6" released by "delete_volume" :: held 0.736s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:24 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-89d44b7d-6259-4b57-b68c-6fc837a4e42d tempest-VolumesTestJSON-278870397 None] Created reservations ['efc499d0-21d1-47b0-9e28-d72298a5fb5b', '2d098f78-4d69-4f36-a881-fdbc99748df5', '9d08ab17-17f8-40ac-8a0d-fc02d3e9cf14', 'c060fe3f-2f6e-4307-bdb3-54a2ed9e9471'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:40:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-89d44b7d-6259-4b57-b68c-6fc837a4e42d tempest-VolumesTestJSON-278870397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-89d44b7d-6259-4b57-b68c-6fc837a4e42d tempest-VolumesTestJSON-278870397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-89d44b7d-6259-4b57-b68c-6fc837a4e42d tempest-VolumesTestJSON-278870397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-89d44b7d-6259-4b57-b68c-6fc837a4e42d tempest-VolumesTestJSON-278870397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-89d44b7d-6259-4b57-b68c-6fc837a4e42d tempest-VolumesTestJSON-278870397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-89d44b7d-6259-4b57-b68c-6fc837a4e42d tempest-VolumesTestJSON-278870397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:24 devstack sudo[99817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:40:24 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d994bac0-6656-4f51-a2c4-f59f6dea8c66 tempest-VolumesTestJSON-278870397 None] Acquiring lock "cinder-144a0d28-7980-4507-9895-afe98321a4a0-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d994bac0-6656-4f51-a2c4-f59f6dea8c66 tempest-VolumesTestJSON-278870397 None] Lock "cinder-144a0d28-7980-4507-9895-afe98321a4a0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d994bac0-6656-4f51-a2c4-f59f6dea8c66 tempest-VolumesTestJSON-278870397 None] Acquiring lock "cinder-quobyte-144a0d28-7980-4507-9895-afe98321a4a0" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d994bac0-6656-4f51-a2c4-f59f6dea8c66 tempest-VolumesTestJSON-278870397 None] Lock "cinder-quobyte-144a0d28-7980-4507-9895-afe98321a4a0" acquired by "delete_volume" :: waited 0.021s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39f1730-b8e2-4a6c-a90c-f91ab4f15b46]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d994bac0-6656-4f51-a2c4-f59f6dea8c66 tempest-VolumesTestJSON-278870397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-144a0d28-7980-4507-9895-afe98321a4a0 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:25 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-89d44b7d-6259-4b57-b68c-6fc837a4e42d tempest-VolumesTestJSON-278870397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.466s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-89d44b7d-6259-4b57-b68c-6fc837a4e42d tempest-VolumesTestJSON-278870397 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:40:25 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-89d44b7d-6259-4b57-b68c-6fc837a4e42d tempest-VolumesTestJSON-278870397 None] Deleted volume successfully.
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-89d44b7d-6259-4b57-b68c-6fc837a4e42d tempest-VolumesTestJSON-278870397 None] Lock "cinder-6bece0fb-da88-4f1f-bb5f-b96cc245bdd6-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:25 devstack sudo[99820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-144a0d28-7980-4507-9895-afe98321a4a0
Nov 07 02:40:25 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Flow 'volume_create_manager' (d2ca25ad-075a-46c7-a0f9-6b38d80880fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e159ef1d-18d5-46f9-9306-71d3f8ac117e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e159ef1d-18d5-46f9-9306-71d3f8ac117e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-436657688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13de1b9e-d54f-4604-b3a5-87880fce7dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dc87316cd714f6ea780d8962de4a0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:25Z,use_quota=True,user_id='67a06cea513449fa8a869e4d8406d31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb5dbfe-c198-4b53-bb70-81a496003afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb5dbfe-c198-4b53-bb70-81a496003afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1b6af5-2f22-41fc-97fb-c188e94b3908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1b6af5-2f22-41fc-97fb-c188e94b3908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13de1b9e-d54f-4604-b3a5-87880fce7dd4', 'volume_name': 'volume-13de1b9e-d54f-4604-b3a5-87880fce7dd4', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a4d237-31c6-45ed-96f7-b19cc0f57a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a4d237-31c6-45ed-96f7-b19cc0f57a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590e80ad-eaac-4ae2-9b35-30c9932b7e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:25 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Volume 13de1b9e-d54f-4604-b3a5-87880fce7dd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13de1b9e-d54f-4604-b3a5-87880fce7dd4', 'volume_size': 1}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-436657688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13de1b9e-d54f-4604-b3a5-87880fce7dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dc87316cd714f6ea780d8962de4a0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:25Z,use_quota=True,user_id='67a06cea513449fa8a869e4d8406d31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Creating volume 13de1b9e-d54f-4604-b3a5-87880fce7dd4 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:40:25 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-13de1b9e-d54f-4604-b3a5-87880fce7dd4 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:25 devstack sudo[99825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-13de1b9e-d54f-4604-b3a5-87880fce7dd4 1073741824
Nov 07 02:40:25 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:25 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d994bac0-6656-4f51-a2c4-f59f6dea8c66 tempest-VolumesTestJSON-278870397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-144a0d28-7980-4507-9895-afe98321a4a0" returned: 0 in 0.482s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d994bac0-6656-4f51-a2c4-f59f6dea8c66 tempest-VolumesTestJSON-278870397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-144a0d28-7980-4507-9895-afe98321a4a0 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:25 devstack sudo[99831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-144a0d28-7980-4507-9895-afe98321a4a0
Nov 07 02:40:25 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:26 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d994bac0-6656-4f51-a2c4-f59f6dea8c66 tempest-VolumesTestJSON-278870397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-144a0d28-7980-4507-9895-afe98321a4a0" returned: 0 in 0.462s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d994bac0-6656-4f51-a2c4-f59f6dea8c66 tempest-VolumesTestJSON-278870397 None] Lock "cinder-quobyte-144a0d28-7980-4507-9895-afe98321a4a0" released by "delete_volume" :: held 1.031s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:26 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-d994bac0-6656-4f51-a2c4-f59f6dea8c66 tempest-VolumesTestJSON-278870397 None] Created reservations ['83028d52-a3fa-4a61-90c0-dba6a17eab29', 'ae9f886f-272b-4372-b9fe-47e4564b74e5', 'a906ff1f-ffa3-47b0-bc60-79836bb66e9f', 'fa105c29-833e-4454-b174-2b5554b4cad3'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:40:26 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-13de1b9e-d54f-4604-b3a5-87880fce7dd4 1073741824" returned: 0 in 0.814s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:26 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-9ffbd4d5-8a1b-441b-afd2-e8630ccd51c2 req-de964c96-53f0-4eb5-802f-55db4143d982 tempest-TestShelveInstance-1331364886 None] Terminate volume connection completed successfully.
Nov 07 02:40:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-9ffbd4d5-8a1b-441b-afd2-e8630ccd51c2 req-de964c96-53f0-4eb5-802f-55db4143d982 tempest-TestShelveInstance-1331364886 None] Deleting attachment fede6c49-6440-4f42-8e19-cb39de717464. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:40:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-13de1b9e-d54f-4604-b3a5-87880fce7dd4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:26 devstack sudo[99856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-13de1b9e-d54f-4604-b3a5-87880fce7dd4
Nov 07 02:40:26 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d994bac0-6656-4f51-a2c4-f59f6dea8c66 tempest-VolumesTestJSON-278870397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d994bac0-6656-4f51-a2c4-f59f6dea8c66 tempest-VolumesTestJSON-278870397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d994bac0-6656-4f51-a2c4-f59f6dea8c66 tempest-VolumesTestJSON-278870397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d994bac0-6656-4f51-a2c4-f59f6dea8c66 tempest-VolumesTestJSON-278870397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d994bac0-6656-4f51-a2c4-f59f6dea8c66 tempest-VolumesTestJSON-278870397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d994bac0-6656-4f51-a2c4-f59f6dea8c66 tempest-VolumesTestJSON-278870397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:26 devstack sudo[99858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:40:26 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:26 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:26 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d994bac0-6656-4f51-a2c4-f59f6dea8c66 tempest-VolumesTestJSON-278870397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.278s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:26 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-d994bac0-6656-4f51-a2c4-f59f6dea8c66 tempest-VolumesTestJSON-278870397 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:40:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-13de1b9e-d54f-4604-b3a5-87880fce7dd4" returned: 0 in 0.343s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:40:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:26 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-d994bac0-6656-4f51-a2c4-f59f6dea8c66 tempest-VolumesTestJSON-278870397 None] Deleted volume successfully.
Nov 07 02:40:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590e80ad-eaac-4ae2-9b35-30c9932b7e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13de1b9e-d54f-4604-b3a5-87880fce7dd4', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac00f496-ded9-458a-9a00-2cd5bc459bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:26 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Volume volume-13de1b9e-d54f-4604-b3a5-87880fce7dd4 (13de1b9e-d54f-4604-b3a5-87880fce7dd4): created successfully
Nov 07 02:40:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac00f496-ded9-458a-9a00-2cd5bc459bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Flow 'volume_create_manager' (d2ca25ad-075a-46c7-a0f9-6b38d80880fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d994bac0-6656-4f51-a2c4-f59f6dea8c66 tempest-VolumesTestJSON-278870397 None] Lock "cinder-144a0d28-7980-4507-9895-afe98321a4a0-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:26 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-5511fc54-303a-490a-a61a-b2fb055339ef tempest-VolumesTransfersV357Test-466511119 None] Created volume successfully.
Nov 07 02:40:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dfec8df1-053b-4654-9fdc-cfcd0a2fa640 tempest-VolumesTestJSON-278870397 None] Acquiring lock "cinder-52837b16-17d9-4453-b58e-796c98a1545a-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dfec8df1-053b-4654-9fdc-cfcd0a2fa640 tempest-VolumesTestJSON-278870397 None] Lock "cinder-52837b16-17d9-4453-b58e-796c98a1545a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dfec8df1-053b-4654-9fdc-cfcd0a2fa640 tempest-VolumesTestJSON-278870397 None] Acquiring lock "cinder-quobyte-52837b16-17d9-4453-b58e-796c98a1545a" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dfec8df1-053b-4654-9fdc-cfcd0a2fa640 tempest-VolumesTestJSON-278870397 None] Lock "cinder-quobyte-52837b16-17d9-4453-b58e-796c98a1545a" acquired by "delete_volume" :: waited 0.024s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:27 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[5788b2fa-d3f3-43ca-a317-b29925a8c96c]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dfec8df1-053b-4654-9fdc-cfcd0a2fa640 tempest-VolumesTestJSON-278870397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-52837b16-17d9-4453-b58e-796c98a1545a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:27 devstack sudo[99862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-52837b16-17d9-4453-b58e-796c98a1545a
Nov 07 02:40:27 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:27 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dfec8df1-053b-4654-9fdc-cfcd0a2fa640 tempest-VolumesTestJSON-278870397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-52837b16-17d9-4453-b58e-796c98a1545a" returned: 0 in 0.471s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dfec8df1-053b-4654-9fdc-cfcd0a2fa640 tempest-VolumesTestJSON-278870397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-52837b16-17d9-4453-b58e-796c98a1545a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:28 devstack sudo[99869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-52837b16-17d9-4453-b58e-796c98a1545a
Nov 07 02:40:28 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:28 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dfec8df1-053b-4654-9fdc-cfcd0a2fa640 tempest-VolumesTestJSON-278870397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-52837b16-17d9-4453-b58e-796c98a1545a" returned: 0 in 0.307s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dfec8df1-053b-4654-9fdc-cfcd0a2fa640 tempest-VolumesTestJSON-278870397 None] Lock "cinder-quobyte-52837b16-17d9-4453-b58e-796c98a1545a" released by "delete_volume" :: held 0.857s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:28 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-dfec8df1-053b-4654-9fdc-cfcd0a2fa640 tempest-VolumesTestJSON-278870397 None] Created reservations ['d9a3eebb-a5e3-46d6-9b1f-eebdd5212524', 'fecd70c7-d64d-40af-ae96-f4e3fffaaa27', 'c7ab2c26-2ce8-4e2c-a198-5808d96ac4e3', '42020eef-04f8-4526-ab84-7c3cead6d3cc'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:40:28 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-a2977d66-142e-4244-8145-1d91bac43a27 tempest-VolumesTransfersV357Test-256409504 None] Transfer volume completed successfully.
Nov 07 02:40:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dfec8df1-053b-4654-9fdc-cfcd0a2fa640 tempest-VolumesTestJSON-278870397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dfec8df1-053b-4654-9fdc-cfcd0a2fa640 tempest-VolumesTestJSON-278870397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-dfec8df1-053b-4654-9fdc-cfcd0a2fa640 tempest-VolumesTestJSON-278870397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-dfec8df1-053b-4654-9fdc-cfcd0a2fa640 tempest-VolumesTestJSON-278870397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dfec8df1-053b-4654-9fdc-cfcd0a2fa640 tempest-VolumesTestJSON-278870397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dfec8df1-053b-4654-9fdc-cfcd0a2fa640 tempest-VolumesTestJSON-278870397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:28 devstack sudo[99874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:40:28 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:28 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dfec8df1-053b-4654-9fdc-cfcd0a2fa640 tempest-VolumesTestJSON-278870397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.336s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:28 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-dfec8df1-053b-4654-9fdc-cfcd0a2fa640 tempest-VolumesTestJSON-278870397 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:40:28 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-dfec8df1-053b-4654-9fdc-cfcd0a2fa640 tempest-VolumesTestJSON-278870397 None] Deleted volume successfully.
Nov 07 02:40:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dfec8df1-053b-4654-9fdc-cfcd0a2fa640 tempest-VolumesTestJSON-278870397 None] Lock "cinder-52837b16-17d9-4453-b58e-796c98a1545a-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:29 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-91f340be-3f57-458f-b645-764d4273cac8 tempest-VolumesTransfersV357Test-929795019 None] Acquiring lock "cinder-13de1b9e-d54f-4604-b3a5-87880fce7dd4-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:29 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-91f340be-3f57-458f-b645-764d4273cac8 tempest-VolumesTransfersV357Test-929795019 None] Lock "cinder-13de1b9e-d54f-4604-b3a5-87880fce7dd4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:29 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-91f340be-3f57-458f-b645-764d4273cac8 tempest-VolumesTransfersV357Test-929795019 None] Acquiring lock "cinder-quobyte-13de1b9e-d54f-4604-b3a5-87880fce7dd4" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:29 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-91f340be-3f57-458f-b645-764d4273cac8 tempest-VolumesTransfersV357Test-929795019 None] Lock "cinder-quobyte-13de1b9e-d54f-4604-b3a5-87880fce7dd4" acquired by "delete_volume" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:29 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e55861a-e91f-47d7-8bf2-b11419573e2e]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-91f340be-3f57-458f-b645-764d4273cac8 tempest-VolumesTransfersV357Test-929795019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-13de1b9e-d54f-4604-b3a5-87880fce7dd4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-9021ac94-7ec3-4375-ad22-e402678a6d1f req-5300cad7-7744-4bf1-b71e-8b4b269d6f45 tempest-TestShelveInstance-1331364886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-9021ac94-7ec3-4375-ad22-e402678a6d1f req-5300cad7-7744-4bf1-b71e-8b4b269d6f45 tempest-TestShelveInstance-1331364886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-9021ac94-7ec3-4375-ad22-e402678a6d1f req-5300cad7-7744-4bf1-b71e-8b4b269d6f45 tempest-TestShelveInstance-1331364886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-9021ac94-7ec3-4375-ad22-e402678a6d1f req-5300cad7-7744-4bf1-b71e-8b4b269d6f45 tempest-TestShelveInstance-1331364886 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c', 'name': 'volume-ea18f68a-84f7-4572-a19a-d43c14ca6701', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ecf128c9-6162-4a67-b00e-3ee95d4cdd44', 'enforce_multipath': True} {{(pid=87054) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:40:29 devstack sudo[99885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-13de1b9e-d54f-4604-b3a5-87880fce7dd4
Nov 07 02:40:29 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:29 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-9021ac94-7ec3-4375-ad22-e402678a6d1f req-5300cad7-7744-4bf1-b71e-8b4b269d6f45 tempest-TestShelveInstance-1331364886 None] attachment_update completed successfully.
Nov 07 02:40:29 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-91f340be-3f57-458f-b645-764d4273cac8 tempest-VolumesTransfersV357Test-929795019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-13de1b9e-d54f-4604-b3a5-87880fce7dd4" returned: 0 in 0.482s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-91f340be-3f57-458f-b645-764d4273cac8 tempest-VolumesTransfersV357Test-929795019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-13de1b9e-d54f-4604-b3a5-87880fce7dd4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:29 devstack sudo[99890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-13de1b9e-d54f-4604-b3a5-87880fce7dd4
Nov 07 02:40:29 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:30 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-91f340be-3f57-458f-b645-764d4273cac8 tempest-VolumesTransfersV357Test-929795019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-13de1b9e-d54f-4604-b3a5-87880fce7dd4" returned: 0 in 0.315s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:30 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-91f340be-3f57-458f-b645-764d4273cac8 tempest-VolumesTransfersV357Test-929795019 None] Lock "cinder-quobyte-13de1b9e-d54f-4604-b3a5-87880fce7dd4" released by "delete_volume" :: held 0.869s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:30 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-91f340be-3f57-458f-b645-764d4273cac8 tempest-VolumesTransfersV357Test-929795019 None] Created reservations ['e90452d4-b0b9-4e9c-a587-e88fe29678f0', 'f6a85af3-b6ac-49ef-a144-817ed2b3bc9c', '4f868e59-a36a-40aa-80d7-63fba730d193', 'fd599b25-002a-46a6-8523-656afca39be8'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:40:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-91f340be-3f57-458f-b645-764d4273cac8 tempest-VolumesTransfersV357Test-929795019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-91f340be-3f57-458f-b645-764d4273cac8 tempest-VolumesTransfersV357Test-929795019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-91f340be-3f57-458f-b645-764d4273cac8 tempest-VolumesTransfersV357Test-929795019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-91f340be-3f57-458f-b645-764d4273cac8 tempest-VolumesTransfersV357Test-929795019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-91f340be-3f57-458f-b645-764d4273cac8 tempest-VolumesTransfersV357Test-929795019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-91f340be-3f57-458f-b645-764d4273cac8 tempest-VolumesTransfersV357Test-929795019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:30 devstack sudo[99893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:40:30 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:30 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-91f340be-3f57-458f-b645-764d4273cac8 tempest-VolumesTransfersV357Test-929795019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.398s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:30 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-91f340be-3f57-458f-b645-764d4273cac8 tempest-VolumesTransfersV357Test-929795019 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:40:30 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-91f340be-3f57-458f-b645-764d4273cac8 tempest-VolumesTransfersV357Test-929795019 None] Deleted volume successfully.
Nov 07 02:40:30 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-91f340be-3f57-458f-b645-764d4273cac8 tempest-VolumesTransfersV357Test-929795019 None] Lock "cinder-13de1b9e-d54f-4604-b3a5-87880fce7dd4-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Flow 'volume_create_manager' (79c52eb9-db6e-45f4-b2c5-16ee2c827cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f18a9119-58e4-46d2-af92-2748bca6b7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f18a9119-58e4-46d2-af92-2748bca6b7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2071820816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e64f7698-e410-4805-937d-1d1ecfdd1cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dc87316cd714f6ea780d8962de4a0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:31Z,use_quota=True,user_id='67a06cea513449fa8a869e4d8406d31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd81d754-1fdb-4bc4-8d15-4bc28f7250fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd81d754-1fdb-4bc4-8d15-4bc28f7250fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e5fd99-d765-4d2d-921b-bc97ab7d2d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e5fd99-d765-4d2d-921b-bc97ab7d2d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e64f7698-e410-4805-937d-1d1ecfdd1cad', 'volume_name': 'volume-e64f7698-e410-4805-937d-1d1ecfdd1cad', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb45481-5425-4654-ab4d-9162e48fca42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb45481-5425-4654-ab4d-9162e48fca42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc1bc16-af26-42db-96a1-824543fc3beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:31 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Volume e64f7698-e410-4805-937d-1d1ecfdd1cad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e64f7698-e410-4805-937d-1d1ecfdd1cad', 'volume_size': 1}
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2071820816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e64f7698-e410-4805-937d-1d1ecfdd1cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dc87316cd714f6ea780d8962de4a0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:31Z,use_quota=True,user_id='67a06cea513449fa8a869e4d8406d31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Creating volume e64f7698-e410-4805-937d-1d1ecfdd1cad {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:40:31 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e64f7698-e410-4805-937d-1d1ecfdd1cad 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:31 devstack sudo[99896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e64f7698-e410-4805-937d-1d1ecfdd1cad 1073741824
Nov 07 02:40:31 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:31 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e64f7698-e410-4805-937d-1d1ecfdd1cad 1073741824" returned: 0 in 0.551s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e64f7698-e410-4805-937d-1d1ecfdd1cad {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:31 devstack sudo[99903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e64f7698-e410-4805-937d-1d1ecfdd1cad
Nov 07 02:40:31 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:32 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e64f7698-e410-4805-937d-1d1ecfdd1cad" returned: 0 in 0.330s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:32 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:40:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc1bc16-af26-42db-96a1-824543fc3beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e64f7698-e410-4805-937d-1d1ecfdd1cad', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36dd6ac2-f8ba-407f-a330-959c6567bcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:32 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Volume volume-e64f7698-e410-4805-937d-1d1ecfdd1cad (e64f7698-e410-4805-937d-1d1ecfdd1cad): created successfully
Nov 07 02:40:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36dd6ac2-f8ba-407f-a330-959c6567bcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Flow 'volume_create_manager' (79c52eb9-db6e-45f4-b2c5-16ee2c827cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:32 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-cd8aa1dc-02ec-4890-a61e-787e761e0f6c tempest-VolumesTransfersV357Test-466511119 None] Created volume successfully.
Nov 07 02:40:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-baf09363-8319-4189-b587-b1b565b92345 tempest-VolumesTransfersV357Test-929795019 None] Acquiring lock "cinder-e64f7698-e410-4805-937d-1d1ecfdd1cad-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-baf09363-8319-4189-b587-b1b565b92345 tempest-VolumesTransfersV357Test-929795019 None] Lock "cinder-e64f7698-e410-4805-937d-1d1ecfdd1cad-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-baf09363-8319-4189-b587-b1b565b92345 tempest-VolumesTransfersV357Test-929795019 None] Acquiring lock "cinder-quobyte-e64f7698-e410-4805-937d-1d1ecfdd1cad" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-baf09363-8319-4189-b587-b1b565b92345 tempest-VolumesTransfersV357Test-929795019 None] Lock "cinder-quobyte-e64f7698-e410-4805-937d-1d1ecfdd1cad" acquired by "delete_volume" :: waited 0.031s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:34 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[decd5b74-da93-4bff-bb67-bc5a42b4cbf8]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-baf09363-8319-4189-b587-b1b565b92345 tempest-VolumesTransfersV357Test-929795019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e64f7698-e410-4805-937d-1d1ecfdd1cad {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:34 devstack sudo[100382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e64f7698-e410-4805-937d-1d1ecfdd1cad
Nov 07 02:40:34 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:34 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-baf09363-8319-4189-b587-b1b565b92345 tempest-VolumesTransfersV357Test-929795019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e64f7698-e410-4805-937d-1d1ecfdd1cad" returned: 0 in 0.469s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-baf09363-8319-4189-b587-b1b565b92345 tempest-VolumesTransfersV357Test-929795019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e64f7698-e410-4805-937d-1d1ecfdd1cad {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:34 devstack sudo[100391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e64f7698-e410-4805-937d-1d1ecfdd1cad
Nov 07 02:40:34 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:34 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-fbb1ed30-7477-45d1-b7e1-4c498056ccd1 tempest-GroupSnapshotsTest-1518963210 None] Group tempest-GroupSnapshotsTest-Group-1938519752: creating
Nov 07 02:40:34 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-fbb1ed30-7477-45d1-b7e1-4c498056ccd1 tempest-GroupSnapshotsTest-1518963210 None] Group tempest-GroupSnapshotsTest-Group-1938519752: created successfully
Nov 07 02:40:34 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-fbb1ed30-7477-45d1-b7e1-4c498056ccd1 tempest-GroupSnapshotsTest-1518963210 None] Create group completed successfully.
Nov 07 02:40:35 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-baf09363-8319-4189-b587-b1b565b92345 tempest-VolumesTransfersV357Test-929795019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e64f7698-e410-4805-937d-1d1ecfdd1cad" returned: 0 in 0.324s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-baf09363-8319-4189-b587-b1b565b92345 tempest-VolumesTransfersV357Test-929795019 None] Lock "cinder-quobyte-e64f7698-e410-4805-937d-1d1ecfdd1cad" released by "delete_volume" :: held 0.892s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:35 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-baf09363-8319-4189-b587-b1b565b92345 tempest-VolumesTransfersV357Test-929795019 None] Created reservations ['14073afc-1261-4556-b32f-5b97fc18822d', '80351fc7-85b6-4772-b24a-c448c99fe2a3', 'b4f81436-dd2f-4403-8864-43fca7823ce7', '0ea29720-51b4-4608-b8cc-04136df06663'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:40:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-baf09363-8319-4189-b587-b1b565b92345 tempest-VolumesTransfersV357Test-929795019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-baf09363-8319-4189-b587-b1b565b92345 tempest-VolumesTransfersV357Test-929795019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-baf09363-8319-4189-b587-b1b565b92345 tempest-VolumesTransfersV357Test-929795019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-baf09363-8319-4189-b587-b1b565b92345 tempest-VolumesTransfersV357Test-929795019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-baf09363-8319-4189-b587-b1b565b92345 tempest-VolumesTransfersV357Test-929795019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-baf09363-8319-4189-b587-b1b565b92345 tempest-VolumesTransfersV357Test-929795019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:35 devstack sudo[100396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:40:35 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:35 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-baf09363-8319-4189-b587-b1b565b92345 tempest-VolumesTransfersV357Test-929795019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.268s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:35 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-baf09363-8319-4189-b587-b1b565b92345 tempest-VolumesTransfersV357Test-929795019 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:40:35 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-baf09363-8319-4189-b587-b1b565b92345 tempest-VolumesTransfersV357Test-929795019 None] Deleted volume successfully.
Nov 07 02:40:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-baf09363-8319-4189-b587-b1b565b92345 tempest-VolumesTransfersV357Test-929795019 None] Lock "cinder-e64f7698-e410-4805-937d-1d1ecfdd1cad-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:36 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:40:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Flow 'volume_create_manager' (fea4ec71-2a95-40a4-9441-832c9c780e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1e2cff-4092-41f5-b09c-d8584998dbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1e2cff-4092-41f5-b09c-d8584998dbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1574182893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5cbb75ce-a8f8-4d29-9fbd-21e79ef2c291,host='devstack@QuobyteHD#QuobyteHD',id=7eae5eaa-d712-4b79-9c66-507664abc88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a672e2dc0b824344988b0918aead1052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:36Z,use_quota=True,user_id='b8b1bec903184487b8bb977e91260e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48e8bf28-af43-4185-b880-f17d05411f81),volume_type_id=48e8bf28-af43-4185-b880-f17d05411f81)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e5fe44-8de0-4133-980f-9a041c8517e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e5fe44-8de0-4133-980f-9a041c8517e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6512bf46-100f-427f-9b9e-ef390ec74c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6512bf46-100f-427f-9b9e-ef390ec74c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eae5eaa-d712-4b79-9c66-507664abc88f', 'volume_name': 'volume-7eae5eaa-d712-4b79-9c66-507664abc88f', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b7bc78-32b5-4b2e-8d18-3fbdfd34ecba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b7bc78-32b5-4b2e-8d18-3fbdfd34ecba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcecdc0a-7d39-4717-8cc9-1ed088b04a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:36 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Volume 7eae5eaa-d712-4b79-9c66-507664abc88f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eae5eaa-d712-4b79-9c66-507664abc88f', 'volume_size': 1}
Nov 07 02:40:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5cbb75ce-a8f8-4d29-9fbd-21e79ef2c291,created_at=2026-11-07T01:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1574182893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5cbb75ce-a8f8-4d29-9fbd-21e79ef2c291,host='devstack@QuobyteHD#QuobyteHD',id=7eae5eaa-d712-4b79-9c66-507664abc88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a672e2dc0b824344988b0918aead1052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:36Z,use_quota=True,user_id='b8b1bec903184487b8bb977e91260e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48e8bf28-af43-4185-b880-f17d05411f81),volume_type_id=48e8bf28-af43-4185-b880-f17d05411f81)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:40:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Creating volume 7eae5eaa-d712-4b79-9c66-507664abc88f {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:40:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:40:36 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:40:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:36 devstack sudo[100400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f 1073741824
Nov 07 02:40:36 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:37 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f 1073741824" returned: 0 in 0.588s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:37 devstack sudo[100406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f
Nov 07 02:40:37 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:37 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f" returned: 0 in 0.308s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:37 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:40:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:37 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcecdc0a-7d39-4717-8cc9-1ed088b04a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eae5eaa-d712-4b79-9c66-507664abc88f', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:37 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e37c623-b3ae-43bf-a4af-2d63ce92160e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:37 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Volume volume-7eae5eaa-d712-4b79-9c66-507664abc88f (7eae5eaa-d712-4b79-9c66-507664abc88f): created successfully
Nov 07 02:40:37 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e37c623-b3ae-43bf-a4af-2d63ce92160e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:37 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Flow 'volume_create_manager' (fea4ec71-2a95-40a4-9441-832c9c780e04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:37 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c9b0af6a-09d9-4334-9009-adb6410f2d2c tempest-GroupSnapshotsTest-1518963210 None] Created volume successfully.
Nov 07 02:40:39 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-1b770292-a83c-4cc6-8562-24bd0c7e8899 tempest-GroupSnapshotsTest-1518963210 None] GroupSnapshot dc54153e-8bb3-4e15-9779-28763853eaa7: creating.
Nov 07 02:40:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1b770292-a83c-4cc6-8562-24bd0c7e8899 tempest-GroupSnapshotsTest-1518963210 None] Group snapshot dc54153e-8bb3-4e15-9779-28763853eaa7: creating. {{(pid=87054) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 07 02:40:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1b770292-a83c-4cc6-8562-24bd0c7e8899 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1b770292-a83c-4cc6-8562-24bd0c7e8899 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-1b770292-a83c-4cc6-8562-24bd0c7e8899 tempest-GroupSnapshotsTest-1518963210 None] Creating offline snapshot c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee of volume 7eae5eaa-d712-4b79-9c66-507664abc88f {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:40:39 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09c67ef-4010-40f5-b257-6074332cf322]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1b770292-a83c-4cc6-8562-24bd0c7e8899 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:39 devstack sudo[100411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f
Nov 07 02:40:39 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:39 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1b770292-a83c-4cc6-8562-24bd0c7e8899 tempest-GroupSnapshotsTest-1518963210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f" returned: 0 in 0.468s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1b770292-a83c-4cc6-8562-24bd0c7e8899 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:39 devstack sudo[100416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee 1G
Nov 07 02:40:39 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:40 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1b770292-a83c-4cc6-8562-24bd0c7e8899 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee 1G" returned: 0 in 0.537s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1b770292-a83c-4cc6-8562-24bd0c7e8899 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eae5eaa-d712-4b79-9c66-507664abc88f -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:40 devstack sudo[100423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eae5eaa-d712-4b79-9c66-507664abc88f -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee
Nov 07 02:40:40 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:40 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1b770292-a83c-4cc6-8562-24bd0c7e8899 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eae5eaa-d712-4b79-9c66-507664abc88f -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee" returned: 0 in 0.375s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:40 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-1b770292-a83c-4cc6-8562-24bd0c7e8899 tempest-GroupSnapshotsTest-1518963210 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:40:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1b770292-a83c-4cc6-8562-24bd0c7e8899 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:40 devstack sudo[100428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee
Nov 07 02:40:40 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:41 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1b770292-a83c-4cc6-8562-24bd0c7e8899 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee" returned: 0 in 0.274s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1b770292-a83c-4cc6-8562-24bd0c7e8899 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:41 devstack sudo[100431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.info
Nov 07 02:40:41 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:41 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1b770292-a83c-4cc6-8562-24bd0c7e8899 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.info" returned: 0 in 0.293s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:41 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-1b770292-a83c-4cc6-8562-24bd0c7e8899 tempest-GroupSnapshotsTest-1518963210 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:40:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1b770292-a83c-4cc6-8562-24bd0c7e8899 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:41 devstack sudo[100434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.info
Nov 07 02:40:41 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:41 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1b770292-a83c-4cc6-8562-24bd0c7e8899 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.info" returned: 0 in 0.271s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1b770292-a83c-4cc6-8562-24bd0c7e8899 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.327s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:41 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-1b770292-a83c-4cc6-8562-24bd0c7e8899 tempest-GroupSnapshotsTest-1518963210 None] group_snapshot dc54153e-8bb3-4e15-9779-28763853eaa7: created successfully
Nov 07 02:40:43 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:40:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Flow 'volume_create_manager' (1f1b3e63-d4fe-45b8-96d2-831b9d3a30ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4087f29-b915-4c46-a899-2afac8433692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4087f29-b915-4c46-a899-2afac8433692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-988511121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a1515c779d419f90fe0ebad5ccd3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:43Z,use_quota=True,user_id='4d183dc580dd4d11a8d2b972b935e66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda870c4-2aa8-4ce4-ad84-75cacf4de5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda870c4-2aa8-4ce4-ad84-75cacf4de5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6eb2d0a-1a06-4a36-b864-e69bfa8daabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6eb2d0a-1a06-4a36-b864-e69bfa8daabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1', 'volume_name': 'volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1faad0-22e4-451e-aed1-47ef45c17ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1faad0-22e4-451e-aed1-47ef45c17ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32fb0f6-df8c-46d8-a191-5075dfe3b18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:43 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Volume 1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1', 'volume_size': 1}
Nov 07 02:40:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-988511121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a1515c779d419f90fe0ebad5ccd3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:43Z,use_quota=True,user_id='4d183dc580dd4d11a8d2b972b935e66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:40:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Creating volume 1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:40:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:40:43 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:40:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:43 devstack sudo[100441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1 1073741824
Nov 07 02:40:43 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:44 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1 1073741824" returned: 0 in 0.429s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:44 devstack sudo[100446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1
Nov 07 02:40:44 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:44 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1" returned: 0 in 0.252s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.696s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "cinder-quobyte-c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef" by "_create_volume_from_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32fb0f6-df8c-46d8-a191-5075dfe3b18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c9b699-ba11-48a8-b31e-21a1a6d7ed89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Creating volume bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef from snapshot c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee {{(pid=87054) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "cinder-quobyte-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef" by "_copy_volume_from_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:44 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Volume volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1 (1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1): created successfully
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c9b699-ba11-48a8-b31e-21a1a6d7ed89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Flow 'volume_create_manager' (1f1b3e63-d4fe-45b8-96d2-831b9d3a30ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] snapshot: c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee, volume: bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef,  {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:40:44 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-0467c226-d0be-4511-a9e8-228fe13e2d22 tempest-VolumesCloneTest-1583605925 None] Created volume successfully.
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f5fc3d-1ea9-455d-b4ce-92242cac767f]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:44 devstack sudo[100449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee
Nov 07 02:40:44 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:44 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee" returned: 0 in 0.352s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eae5eaa-d712-4b79-9c66-507664abc88f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2756011-0774-4279-86db-d62b8c057a78]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:45 devstack sudo[100454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f
Nov 07 02:40:45 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:45 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f" returned: 0 in 0.385s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:40:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Creating direct copy from snapshot {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:40:45 devstack cinder-volume[87054]: DEBUG cinder.utils [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Path /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef not found in is_blk_device check {{(pid=87054) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:40:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:45 devstack sudo[100459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef
Nov 07 02:40:45 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:46 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:40:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Flow 'volume_create_manager' (97c3cf61-13c4-45a6-bbfe-8c0afe9bf574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:40:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (365386dd-5c06-406f-a53e-4f03934d913d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (365386dd-5c06-406f-a53e-4f03934d913d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-582402926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb75f12-da31-4ce0-bff1-dd77c12c32cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a1515c779d419f90fe0ebad5ccd3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:40:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1,status='creating',terminated_at=None,updated_at=2026-11-07T01:40:47Z,use_quota=True,user_id='4d183dc580dd4d11a8d2b972b935e66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3c76cc-81fe-4e6c-9572-09df10ba7bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3c76cc-81fe-4e6c-9572-09df10ba7bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c489c9bd-a38f-42a5-bab1-ca285e409ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c489c9bd-a38f-42a5-bab1-ca285e409ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4eb75f12-da31-4ce0-bff1-dd77c12c32cb', 'volume_name': 'volume-4eb75f12-da31-4ce0-bff1-dd77c12c32cb', 'volume_size': 2, 'source_volid': '1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1', 'source_volstatus': 'available'}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c75ca92-105a-4eba-ae22-2c57ca8128a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c75ca92-105a-4eba-ae22-2c57ca8128a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:40:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be87230c-6522-4e84-84b3-24a3e6f5239b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:40:46 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Volume 4eb75f12-da31-4ce0-bff1-dd77c12c32cb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4eb75f12-da31-4ce0-bff1-dd77c12c32cb', 'volume_size': 2, 'source_volid': '1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1', 'source_volstatus': 'available'}
Nov 07 02:40:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:52 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef" returned: 0 in 7.065s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:52 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Image conversion details: src /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f, size 1024.00 MB, duration 7.07 sec, destination /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:40:52 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Converted 1024.00 MB image at 144.91 MB/s
Nov 07 02:40:52 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:40:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:52 devstack sudo[100478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef
Nov 07 02:40:52 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:52 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef" returned: 0 in 0.245s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef" released by "_copy_volume_from_snapshot" :: held 8.145s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef" released by "_create_volume_from_snapshot" :: held 8.238s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.277s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.806s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:52 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Cloning volume 1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1 to volume 4eb75f12-da31-4ce0-bff1-dd77c12c32cb
Nov 07 02:40:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Creating offline snapshot 95b62b3f-6af8-489a-ab3f-7badb1de39af of volume 1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:40:52 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e797d0d-106b-45bc-86dd-eed81f2fdae5]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:52 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ace5b795-74ed-4781-9f05-1732bbfa4d14 tempest-GroupSnapshotsTest-1518963210 None] Create group from source-snapshot-dc54153e-8bb3-4e15-9779-28763853eaa7 completed successfully.
Nov 07 02:40:52 devstack sudo[100505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1
Nov 07 02:40:52 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:53 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1" returned: 0 in 0.350s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.95b62b3f-6af8-489a-ab3f-7badb1de39af 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:53 devstack sudo[100510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.95b62b3f-6af8-489a-ab3f-7badb1de39af 1G
Nov 07 02:40:53 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:53 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.95b62b3f-6af8-489a-ab3f-7badb1de39af 1G" returned: 0 in 0.361s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.95b62b3f-6af8-489a-ab3f-7badb1de39af {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:53 devstack sudo[100516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.95b62b3f-6af8-489a-ab3f-7badb1de39af
Nov 07 02:40:53 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:53 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.95b62b3f-6af8-489a-ab3f-7badb1de39af" returned: 0 in 0.272s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:53 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.95b62b3f-6af8-489a-ab3f-7badb1de39af is being set with open permissions: ugo+rw
Nov 07 02:40:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.95b62b3f-6af8-489a-ab3f-7badb1de39af {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:53 devstack sudo[100521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.95b62b3f-6af8-489a-ab3f-7badb1de39af
Nov 07 02:40:53 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:53 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.95b62b3f-6af8-489a-ab3f-7badb1de39af" returned: 0 in 0.246s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:54 devstack sudo[100524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.info
Nov 07 02:40:54 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:54 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.info" returned: 0 in 0.255s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:54 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.info is being set with open permissions: ugo+rw
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:54 devstack sudo[100527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.info
Nov 07 02:40:54 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-24098af3-5a53-4b6c-995f-5368ef4f079f tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "cinder-quobyte-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-24098af3-5a53-4b6c-995f-5368ef4f079f tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef" acquired by "delete_volume" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6548917-5af4-4b7b-8a17-10feb8012a4d]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-24098af3-5a53-4b6c-995f-5368ef4f079f tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:54 devstack sudo[100529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef
Nov 07 02:40:54 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:54 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.info" returned: 0 in 0.252s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Acquiring lock "cinder-quobyte-4eb75f12-da31-4ce0-bff1-dd77c12c32cb" by "_copy_volume_from_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Lock "cinder-quobyte-4eb75f12-da31-4ce0-bff1-dd77c12c32cb" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] snapshot: 95b62b3f-6af8-489a-ab3f-7badb1de39af, volume: 4eb75f12-da31-4ce0-bff1-dd77c12c32cb,  {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab01bf2-6c1b-48bc-ba51-2c39edfe40b8]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.95b62b3f-6af8-489a-ab3f-7badb1de39af {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:54 devstack sudo[100532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.95b62b3f-6af8-489a-ab3f-7badb1de39af
Nov 07 02:40:54 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:54 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-24098af3-5a53-4b6c-995f-5368ef4f079f tempest-GroupSnapshotsTest-1518963210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef" returned: 0 in 0.374s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-24098af3-5a53-4b6c-995f-5368ef4f079f tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:54 devstack sudo[100537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef
Nov 07 02:40:54 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:54 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.95b62b3f-6af8-489a-ab3f-7badb1de39af" returned: 0 in 0.373s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d406ab3-edc9-42d5-97c4-8acdf3e1641e]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:54 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-24098af3-5a53-4b6c-995f-5368ef4f079f tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef" returned: 0 in 0.269s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-24098af3-5a53-4b6c-995f-5368ef4f079f tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-bb2c4a0f-3a50-402d-8d9a-dca3cbe9ebef" released by "delete_volume" :: held 0.688s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-24098af3-5a53-4b6c-995f-5368ef4f079f tempest-GroupSnapshotsTest-1518963210 None] Created reservations ['2bdab9e8-d3c2-4a8c-ab11-38d48a8d2629'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:40:55 devstack sudo[100543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1
Nov 07 02:40:55 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:55 devstack cinder-volume[87054]: WARNING cinder.quota [None req-24098af3-5a53-4b6c-995f-5368ef4f079f tempest-GroupSnapshotsTest-1518963210 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-723726005 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-723726005, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:40:55 devstack cinder-volume[87054]: WARNING cinder.quota [None req-24098af3-5a53-4b6c-995f-5368ef4f079f tempest-GroupSnapshotsTest-1518963210 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-723726005 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-723726005, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-24098af3-5a53-4b6c-995f-5368ef4f079f tempest-GroupSnapshotsTest-1518963210 None] Created reservations ['8428592f-b105-4611-a3de-914c0078938d', '18a08db2-23da-49dd-b861-db136d455753', '3987fc11-c77e-471a-b0c9-78ac6465bc1a', '202061e4-5dba-4264-9cae-62feb316da17'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-24098af3-5a53-4b6c-995f-5368ef4f079f tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-24098af3-5a53-4b6c-995f-5368ef4f079f tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-24098af3-5a53-4b6c-995f-5368ef4f079f tempest-GroupSnapshotsTest-1518963210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-24098af3-5a53-4b6c-995f-5368ef4f079f tempest-GroupSnapshotsTest-1518963210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-24098af3-5a53-4b6c-995f-5368ef4f079f tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-24098af3-5a53-4b6c-995f-5368ef4f079f tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:55 devstack sudo[100545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:40:55 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:55 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1" returned: 0 in 0.387s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1 {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Creating direct copy from snapshot {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG cinder.utils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Path /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4eb75f12-da31-4ce0-bff1-dd77c12c32cb not found in is_blk_device check {{(pid=87054) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4eb75f12-da31-4ce0-bff1-dd77c12c32cb {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:55 devstack sudo[100551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4eb75f12-da31-4ce0-bff1-dd77c12c32cb
Nov 07 02:40:55 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:55 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-24098af3-5a53-4b6c-995f-5368ef4f079f tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.261s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-24098af3-5a53-4b6c-995f-5368ef4f079f tempest-GroupSnapshotsTest-1518963210 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:40:55 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-24098af3-5a53-4b6c-995f-5368ef4f079f tempest-GroupSnapshotsTest-1518963210 None] Delete group completed successfully.
Nov 07 02:40:55 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-de2bdba7-8ccb-40ca-b987-9e8b77f89e4d tempest-GroupSnapshotsTest-1518963210 None] group_snapshot dc54153e-8bb3-4e15-9779-28763853eaa7: deleting
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-de2bdba7-8ccb-40ca-b987-9e8b77f89e4d tempest-GroupSnapshotsTest-1518963210 None] group_snapshot dc54153e-8bb3-4e15-9779-28763853eaa7: deleting {{(pid=87054) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-de2bdba7-8ccb-40ca-b987-9e8b77f89e4d tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "cinder-quobyte-7eae5eaa-d712-4b79-9c66-507664abc88f" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-de2bdba7-8ccb-40ca-b987-9e8b77f89e4d tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-7eae5eaa-d712-4b79-9c66-507664abc88f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-de2bdba7-8ccb-40ca-b987-9e8b77f89e4d tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "cinder-quobyte-c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-de2bdba7-8ccb-40ca-b987-9e8b77f89e4d tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-de2bdba7-8ccb-40ca-b987-9e8b77f89e4d tempest-GroupSnapshotsTest-1518963210 None] Deleting offline snapshot c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee of volume 7eae5eaa-d712-4b79-9c66-507664abc88f {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-de2bdba7-8ccb-40ca-b987-9e8b77f89e4d tempest-GroupSnapshotsTest-1518963210 None] snapshot_file for this snap is: volume-7eae5eaa-d712-4b79-9c66-507664abc88f.c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[563c0ca6-1f2e-4df0-9de8-a5296f591bc6]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-de2bdba7-8ccb-40ca-b987-9e8b77f89e4d tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:55 devstack sudo[100557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee
Nov 07 02:40:55 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:56 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-de2bdba7-8ccb-40ca-b987-9e8b77f89e4d tempest-GroupSnapshotsTest-1518963210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee" returned: 0 in 0.485s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:56 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-de2bdba7-8ccb-40ca-b987-9e8b77f89e4d tempest-GroupSnapshotsTest-1518963210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eae5eaa-d712-4b79-9c66-507664abc88f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:40:56 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d0dc61-70c6-43e2-8555-8987dbef1111]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-de2bdba7-8ccb-40ca-b987-9e8b77f89e4d tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:56 devstack sudo[100569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f
Nov 07 02:40:56 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:57 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-de2bdba7-8ccb-40ca-b987-9e8b77f89e4d tempest-GroupSnapshotsTest-1518963210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f" returned: 0 in 0.778s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-de2bdba7-8ccb-40ca-b987-9e8b77f89e4d tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:57 devstack sudo[100574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee
Nov 07 02:40:57 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:57 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-de2bdba7-8ccb-40ca-b987-9e8b77f89e4d tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee" returned: 0 in 0.539s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-de2bdba7-8ccb-40ca-b987-9e8b77f89e4d tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:57 devstack sudo[100579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee
Nov 07 02:40:57 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:57 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-de2bdba7-8ccb-40ca-b987-9e8b77f89e4d tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f.c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee" returned: 0 in 0.300s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:57 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-de2bdba7-8ccb-40ca-b987-9e8b77f89e4d tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-c7a68d8d-2e87-4c53-afa3-bdc9bcd0f6ee" released by "_delete_snapshot" :: held 2.292s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:57 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-de2bdba7-8ccb-40ca-b987-9e8b77f89e4d tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-7eae5eaa-d712-4b79-9c66-507664abc88f" released by "delete_snapshot" :: held 2.319s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:40:58 devstack cinder-volume[87054]: WARNING cinder.quota [None req-de2bdba7-8ccb-40ca-b987-9e8b77f89e4d tempest-GroupSnapshotsTest-1518963210 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-723726005 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-723726005, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:40:58 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-de2bdba7-8ccb-40ca-b987-9e8b77f89e4d tempest-GroupSnapshotsTest-1518963210 None] Created reservations ['dbbda323-8d92-41a6-aed4-80b886ac5121', '865dc4f2-1a48-4bd9-acbe-aceff0085028', '13a1ff4d-cea7-4fdd-9a1f-1d2c562a0702', '83014c99-8167-4a63-a672-1cda64273fc3'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:40:58 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-de2bdba7-8ccb-40ca-b987-9e8b77f89e4d tempest-GroupSnapshotsTest-1518963210 None] group_snapshot dc54153e-8bb3-4e15-9779-28763853eaa7: deleted successfully
Nov 07 02:40:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:40:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:40:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:40:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:40:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:40:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:40:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:59 devstack sudo[100583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:40:59 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:40:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b054333f-6d59-4e10-b393-b276c5cb30ab tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "cinder-quobyte-7eae5eaa-d712-4b79-9c66-507664abc88f" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:40:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b054333f-6d59-4e10-b393-b276c5cb30ab tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-7eae5eaa-d712-4b79-9c66-507664abc88f" acquired by "delete_volume" :: waited 0.055s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:40:59 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root
Nov 07 02:40:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.555s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:40:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:40:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:40:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 28 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:40:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>, <Thread(fd_logger, started daemon 125443282798592)>, <Thread(privsep_reader, started daemon 125443284556288)>, <Thread(tpool_thread_0, started daemon 125443276445376)>, <Thread(tpool_thread_1, started daemon 125443268036288)>, <Thread(tpool_thread_2, started daemon 125443259627200)>, <Thread(tpool_thread_3, started daemon 125443251218112)>, <Thread(tpool_thread_4, started daemon 125443242809024)>, <Thread(tpool_thread_5, started daemon 125443234399936)>, <Thread(tpool_thread_6, started daemon 125443225990848)>, <Thread(tpool_thread_7, started daemon 125443217581760)>, <Thread(tpool_thread_8, started daemon 125443209172672)>, <Thread(tpool_thread_9, started daemon 125443200763584)>, <Thread(tpool_thread_10, started daemon 125443192354496)>, <Thread(tpool_thread_11, started daemon 125443183945408)>, <Thread(tpool_thread_12, started daemon 125443175536320)>, <Thread(tpool_thread_13, started daemon 125443167127232)>, <Thread(tpool_thread_14, started daemon 125443158718144)>, <Thread(tpool_thread_15, started daemon 125443150309056)>, <Thread(tpool_thread_16, started daemon 125443141899968)>, <Thread(tpool_thread_17, started daemon 125443133490880)>, <Thread(tpool_thread_18, started daemon 125443125081792)>, <Thread(tpool_thread_19, started daemon 125443116672704)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:40:59 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[384b7069-b234-4455-aac9-3f1c6640ce38]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:40:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b054333f-6d59-4e10-b393-b276c5cb30ab tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:40:59 devstack sudo[100621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f
Nov 07 02:40:59 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:00 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b054333f-6d59-4e10-b393-b276c5cb30ab tempest-GroupSnapshotsTest-1518963210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f" returned: 0 in 0.658s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b054333f-6d59-4e10-b393-b276c5cb30ab tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:00 devstack sudo[100628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f
Nov 07 02:41:00 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:00 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b054333f-6d59-4e10-b393-b276c5cb30ab tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7eae5eaa-d712-4b79-9c66-507664abc88f" returned: 0 in 0.359s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:00 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b054333f-6d59-4e10-b393-b276c5cb30ab tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-7eae5eaa-d712-4b79-9c66-507664abc88f" released by "delete_volume" :: held 1.210s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:00 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-b054333f-6d59-4e10-b393-b276c5cb30ab tempest-GroupSnapshotsTest-1518963210 None] Created reservations ['16ef4cff-638d-48dc-897a-0d632725861c'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:01 devstack cinder-volume[87054]: WARNING cinder.db.api [None req-b054333f-6d59-4e10-b393-b276c5cb30ab tempest-GroupSnapshotsTest-1518963210 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-723726005']
Nov 07 02:41:01 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-b054333f-6d59-4e10-b393-b276c5cb30ab tempest-GroupSnapshotsTest-1518963210 None] Created reservations ['6c4b9ced-a8d6-4418-9246-3c3bed98bac4', 'b6e1d6bb-3f49-43a7-bcd0-494a99766543', '0eb6443b-4833-44d5-b913-e63f1555a3b3', '90d7572f-1c1b-473a-ab11-704979a07fdb'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b054333f-6d59-4e10-b393-b276c5cb30ab tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b054333f-6d59-4e10-b393-b276c5cb30ab tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:01 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b054333f-6d59-4e10-b393-b276c5cb30ab tempest-GroupSnapshotsTest-1518963210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:01 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b054333f-6d59-4e10-b393-b276c5cb30ab tempest-GroupSnapshotsTest-1518963210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b054333f-6d59-4e10-b393-b276c5cb30ab tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b054333f-6d59-4e10-b393-b276c5cb30ab tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:01 devstack sudo[100632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:41:01 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:01 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b054333f-6d59-4e10-b393-b276c5cb30ab tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.386s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:01 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-b054333f-6d59-4e10-b393-b276c5cb30ab tempest-GroupSnapshotsTest-1518963210 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:41:01 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b054333f-6d59-4e10-b393-b276c5cb30ab tempest-GroupSnapshotsTest-1518963210 None] Delete group completed successfully.
Nov 07 02:41:02 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4eb75f12-da31-4ce0-bff1-dd77c12c32cb" returned: 0 in 7.411s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:02 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Image conversion details: src /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1, size 1024.00 MB, duration 7.41 sec, destination /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4eb75f12-da31-4ce0-bff1-dd77c12c32cb {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:41:02 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Converted 1024.00 MB image at 138.14 MB/s
Nov 07 02:41:02 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4eb75f12-da31-4ce0-bff1-dd77c12c32cb is being set with open permissions: ugo+rw
Nov 07 02:41:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4eb75f12-da31-4ce0-bff1-dd77c12c32cb {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:02 devstack sudo[100635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4eb75f12-da31-4ce0-bff1-dd77c12c32cb
Nov 07 02:41:02 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:02 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=135,cinder:UPDATE=169,cinder:DELETE=10,cinder:INSERT=43 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:41:02 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-e1dcba4f-5f12-43ce-8375-92d79bc95d90 tempest-GroupSnapshotsTest-1518963210 None] Group tempest-GroupSnapshotsTest-Group-417388534: creating
Nov 07 02:41:02 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-e1dcba4f-5f12-43ce-8375-92d79bc95d90 tempest-GroupSnapshotsTest-1518963210 None] Group tempest-GroupSnapshotsTest-Group-417388534: created successfully
Nov 07 02:41:02 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-e1dcba4f-5f12-43ce-8375-92d79bc95d90 tempest-GroupSnapshotsTest-1518963210 None] Create group completed successfully.
Nov 07 02:41:03 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4eb75f12-da31-4ce0-bff1-dd77c12c32cb" returned: 0 in 0.246s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:03 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Lock "cinder-quobyte-4eb75f12-da31-4ce0-bff1-dd77c12c32cb" released by "_copy_volume_from_snapshot" :: held 8.483s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:03 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Acquiring lock "cinder-quobyte-95b62b3f-6af8-489a-ab3f-7badb1de39af" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:03 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Lock "cinder-quobyte-95b62b3f-6af8-489a-ab3f-7badb1de39af" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Deleting offline snapshot 95b62b3f-6af8-489a-ab3f-7badb1de39af of volume 1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:41:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] snapshot_file for this snap is: volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.95b62b3f-6af8-489a-ab3f-7badb1de39af {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:41:03 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[268d2a23-948a-420d-883a-f6cd2eb7085b]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.95b62b3f-6af8-489a-ab3f-7badb1de39af {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:03 devstack sudo[100638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.95b62b3f-6af8-489a-ab3f-7badb1de39af
Nov 07 02:41:03 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:03 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.95b62b3f-6af8-489a-ab3f-7badb1de39af" returned: 0 in 0.342s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:41:03 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[343aea14-08be-4dc0-af6b-b97e63d92aa3]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:03 devstack sudo[100643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1
Nov 07 02:41:03 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:03 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1" returned: 0 in 0.524s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.95b62b3f-6af8-489a-ab3f-7badb1de39af {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:04 devstack sudo[100648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.95b62b3f-6af8-489a-ab3f-7badb1de39af
Nov 07 02:41:04 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:04 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.95b62b3f-6af8-489a-ab3f-7badb1de39af" returned: 0 in 0.355s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.95b62b3f-6af8-489a-ab3f-7badb1de39af {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:04 devstack sudo[100653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.95b62b3f-6af8-489a-ab3f-7badb1de39af
Nov 07 02:41:04 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Flow 'volume_create_manager' (95ccea1e-60f1-49b6-bb54-871e59b533d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a2d126-234b-49ab-ad4e-d3b43b6420e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:UPDATE=180,cinder:SELECT=143,cinder:INSERT=37,cinder:DELETE=16 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a2d126-234b-49ab-ad4e-d3b43b6420e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-528247997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bb0144b7-42d0-4d72-b246-dddd0ea83c24,host='devstack@QuobyteHD#QuobyteHD',id=2aeb46de-0e4b-4d7a-b67d-cbda9992b918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a672e2dc0b824344988b0918aead1052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:04Z,use_quota=True,user_id='b8b1bec903184487b8bb977e91260e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09d45eac-4c70-42f5-b9d8-6f44ad37c13e),volume_type_id=09d45eac-4c70-42f5-b9d8-6f44ad37c13e)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471ffcb0-e920-4d34-851b-3b21bd724cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471ffcb0-e920-4d34-851b-3b21bd724cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc5e34f-5374-473c-ba92-cdcaf67ed071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc5e34f-5374-473c-ba92-cdcaf67ed071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aeb46de-0e4b-4d7a-b67d-cbda9992b918', 'volume_name': 'volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a6a877f-ec68-4593-86ee-ee7aeabfb930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a6a877f-ec68-4593-86ee-ee7aeabfb930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e17bba03-7d90-4f24-a346-826f5842e4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:04 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Volume 2aeb46de-0e4b-4d7a-b67d-cbda9992b918: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918', 'volume_size': 1}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:04 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1.95b62b3f-6af8-489a-ab3f-7badb1de39af" returned: 0 in 0.257s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Lock "cinder-quobyte-95b62b3f-6af8-489a-ab3f-7badb1de39af" released by "_delete_snapshot" :: held 1.569s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.995s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.084s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=bb0144b7-42d0-4d72-b246-dddd0ea83c24,created_at=2026-11-07T01:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-528247997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bb0144b7-42d0-4d72-b246-dddd0ea83c24,host='devstack@QuobyteHD#QuobyteHD',id=2aeb46de-0e4b-4d7a-b67d-cbda9992b918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a672e2dc0b824344988b0918aead1052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:04Z,use_quota=True,user_id='b8b1bec903184487b8bb977e91260e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09d45eac-4c70-42f5-b9d8-6f44ad37c13e),volume_type_id=09d45eac-4c70-42f5-b9d8-6f44ad37c13e)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Creating volume 2aeb46de-0e4b-4d7a-b67d-cbda9992b918 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:41:04 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:04 devstack sudo[100656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918 1073741824
Nov 07 02:41:04 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be87230c-6522-4e84-84b3-24a3e6f5239b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eb75f12-da31-4ce0-bff1-dd77c12c32cb', 'volume_size': 2, 'source_volid': '1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1', 'source_volstatus': 'available'}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02718d0d-40b2-421c-9742-08bf40a3c096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:04 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Volume volume-4eb75f12-da31-4ce0-bff1-dd77c12c32cb (4eb75f12-da31-4ce0-bff1-dd77c12c32cb): created successfully
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02718d0d-40b2-421c-9742-08bf40a3c096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Flow 'volume_create_manager' (97c3cf61-13c4-45a6-bbfe-8c0afe9bf574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:04 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-7d833ad7-5725-4ae9-8cbb-0fa7be8ab1b2 tempest-VolumesCloneTest-1583605925 None] Created volume successfully.
Nov 07 02:41:05 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918 1073741824" returned: 0 in 0.430s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:05 devstack sudo[100662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918
Nov 07 02:41:05 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f6285f73-6d85-4429-b435-9c2d15228dd7 tempest-VolumesCloneTest-1583605925 None] Acquiring lock "cinder-4eb75f12-da31-4ce0-bff1-dd77c12c32cb-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f6285f73-6d85-4429-b435-9c2d15228dd7 tempest-VolumesCloneTest-1583605925 None] Lock "cinder-4eb75f12-da31-4ce0-bff1-dd77c12c32cb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f6285f73-6d85-4429-b435-9c2d15228dd7 tempest-VolumesCloneTest-1583605925 None] Acquiring lock "cinder-quobyte-4eb75f12-da31-4ce0-bff1-dd77c12c32cb" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f6285f73-6d85-4429-b435-9c2d15228dd7 tempest-VolumesCloneTest-1583605925 None] Lock "cinder-quobyte-4eb75f12-da31-4ce0-bff1-dd77c12c32cb" acquired by "delete_volume" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:05 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ef62c8-8bdc-4160-ae6a-7130b9135403]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f6285f73-6d85-4429-b435-9c2d15228dd7 tempest-VolumesCloneTest-1583605925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4eb75f12-da31-4ce0-bff1-dd77c12c32cb {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:05 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918" returned: 0 in 0.266s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:41:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e17bba03-7d90-4f24-a346-826f5842e4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e75df3-ba45-49de-8f6d-7ddd4e7633a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:05 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Volume volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918 (2aeb46de-0e4b-4d7a-b67d-cbda9992b918): created successfully
Nov 07 02:41:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e75df3-ba45-49de-8f6d-7ddd4e7633a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Flow 'volume_create_manager' (95ccea1e-60f1-49b6-bb54-871e59b533d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:05 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-3688327f-1889-4a6f-baa8-cf965ac2b511 tempest-GroupSnapshotsTest-1518963210 None] Created volume successfully.
Nov 07 02:41:05 devstack sudo[100665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4eb75f12-da31-4ce0-bff1-dd77c12c32cb
Nov 07 02:41:05 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:05 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f6285f73-6d85-4429-b435-9c2d15228dd7 tempest-VolumesCloneTest-1583605925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4eb75f12-da31-4ce0-bff1-dd77c12c32cb" returned: 0 in 0.367s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f6285f73-6d85-4429-b435-9c2d15228dd7 tempest-VolumesCloneTest-1583605925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4eb75f12-da31-4ce0-bff1-dd77c12c32cb {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:05 devstack sudo[100671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4eb75f12-da31-4ce0-bff1-dd77c12c32cb
Nov 07 02:41:05 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:06 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f6285f73-6d85-4429-b435-9c2d15228dd7 tempest-VolumesCloneTest-1583605925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4eb75f12-da31-4ce0-bff1-dd77c12c32cb" returned: 0 in 0.267s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f6285f73-6d85-4429-b435-9c2d15228dd7 tempest-VolumesCloneTest-1583605925 None] Lock "cinder-quobyte-4eb75f12-da31-4ce0-bff1-dd77c12c32cb" released by "delete_volume" :: held 0.676s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-f6285f73-6d85-4429-b435-9c2d15228dd7 tempest-VolumesCloneTest-1583605925 None] Created reservations ['1a25b203-0e47-4d72-99e4-f48fd23b67f1', '1c6fa8ad-b189-43c2-b37b-91c3e16e560b', 'dd0a12ec-6586-4baf-87c3-3cb12aa78654', '5d26064b-795f-47aa-b3e2-79e16950c335'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f6285f73-6d85-4429-b435-9c2d15228dd7 tempest-VolumesCloneTest-1583605925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f6285f73-6d85-4429-b435-9c2d15228dd7 tempest-VolumesCloneTest-1583605925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f6285f73-6d85-4429-b435-9c2d15228dd7 tempest-VolumesCloneTest-1583605925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f6285f73-6d85-4429-b435-9c2d15228dd7 tempest-VolumesCloneTest-1583605925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f6285f73-6d85-4429-b435-9c2d15228dd7 tempest-VolumesCloneTest-1583605925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f6285f73-6d85-4429-b435-9c2d15228dd7 tempest-VolumesCloneTest-1583605925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:06 devstack sudo[100674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:41:06 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Flow 'volume_create_manager' (2cedff0e-2104-403a-a800-9c5e141f7857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78994e6f-7f7f-47d7-8e72-cbab92418c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78994e6f-7f7f-47d7-8e72-cbab92418c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1808389056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bb0144b7-42d0-4d72-b246-dddd0ea83c24,host='devstack@QuobyteHD#QuobyteHD',id=9103639a-7a35-42b3-948a-c00fae258b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a672e2dc0b824344988b0918aead1052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:06Z,use_quota=True,user_id='b8b1bec903184487b8bb977e91260e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09d45eac-4c70-42f5-b9d8-6f44ad37c13e),volume_type_id=09d45eac-4c70-42f5-b9d8-6f44ad37c13e)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa2ca05-60c6-4a63-8447-36003112f55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa2ca05-60c6-4a63-8447-36003112f55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd65bbc-9ea1-42fb-9f64-322e15bbf110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd65bbc-9ea1-42fb-9f64-322e15bbf110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9103639a-7a35-42b3-948a-c00fae258b75', 'volume_name': 'volume-9103639a-7a35-42b3-948a-c00fae258b75', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a2e54f-7e67-49c2-831f-ff277d860736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a2e54f-7e67-49c2-831f-ff277d860736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e71b93-182a-4084-896a-c9c63df9e7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:06 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Volume 9103639a-7a35-42b3-948a-c00fae258b75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9103639a-7a35-42b3-948a-c00fae258b75', 'volume_size': 1}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=bb0144b7-42d0-4d72-b246-dddd0ea83c24,created_at=2026-11-07T01:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1808389056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bb0144b7-42d0-4d72-b246-dddd0ea83c24,host='devstack@QuobyteHD#QuobyteHD',id=9103639a-7a35-42b3-948a-c00fae258b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a672e2dc0b824344988b0918aead1052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:06Z,use_quota=True,user_id='b8b1bec903184487b8bb977e91260e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09d45eac-4c70-42f5-b9d8-6f44ad37c13e),volume_type_id=09d45eac-4c70-42f5-b9d8-6f44ad37c13e)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Creating volume 9103639a-7a35-42b3-948a-c00fae258b75 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:41:06 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:06 devstack sudo[100677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75 1073741824
Nov 07 02:41:06 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:06 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f6285f73-6d85-4429-b435-9c2d15228dd7 tempest-VolumesCloneTest-1583605925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.258s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-f6285f73-6d85-4429-b435-9c2d15228dd7 tempest-VolumesCloneTest-1583605925 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:41:06 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f6285f73-6d85-4429-b435-9c2d15228dd7 tempest-VolumesCloneTest-1583605925 None] Deleted volume successfully.
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f6285f73-6d85-4429-b435-9c2d15228dd7 tempest-VolumesCloneTest-1583605925 None] Lock "cinder-4eb75f12-da31-4ce0-bff1-dd77c12c32cb-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7116d30a-55df-42bf-9320-5a24e584d279 tempest-VolumesCloneTest-1583605925 None] Acquiring lock "cinder-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7116d30a-55df-42bf-9320-5a24e584d279 tempest-VolumesCloneTest-1583605925 None] Lock "cinder-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7116d30a-55df-42bf-9320-5a24e584d279 tempest-VolumesCloneTest-1583605925 None] Acquiring lock "cinder-quobyte-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7116d30a-55df-42bf-9320-5a24e584d279 tempest-VolumesCloneTest-1583605925 None] Lock "cinder-quobyte-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1" acquired by "delete_volume" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6074b8-fa17-444d-a5f0-eb5b4cdfd1b3]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7116d30a-55df-42bf-9320-5a24e584d279 tempest-VolumesCloneTest-1583605925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:06 devstack sudo[100681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1
Nov 07 02:41:06 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:06 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75 1073741824" returned: 0 in 0.465s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:06 devstack sudo[100685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75
Nov 07 02:41:06 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:07 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7116d30a-55df-42bf-9320-5a24e584d279 tempest-VolumesCloneTest-1583605925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1" returned: 0 in 0.373s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7116d30a-55df-42bf-9320-5a24e584d279 tempest-VolumesCloneTest-1583605925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:07 devstack sudo[100690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1
Nov 07 02:41:07 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:07 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75" returned: 0 in 0.246s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:07 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:41:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e71b93-182a-4084-896a-c9c63df9e7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9103639a-7a35-42b3-948a-c00fae258b75', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a9c4c7-1f79-4215-8cf6-9064d42e7f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:07 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Volume volume-9103639a-7a35-42b3-948a-c00fae258b75 (9103639a-7a35-42b3-948a-c00fae258b75): created successfully
Nov 07 02:41:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a9c4c7-1f79-4215-8cf6-9064d42e7f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Flow 'volume_create_manager' (2cedff0e-2104-403a-a800-9c5e141f7857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:07 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-fc7ea2ad-2d0e-4d58-ba3e-fea764fbdc31 tempest-GroupSnapshotsTest-1518963210 None] Created volume successfully.
Nov 07 02:41:07 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7116d30a-55df-42bf-9320-5a24e584d279 tempest-VolumesCloneTest-1583605925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1" returned: 0 in 0.255s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7116d30a-55df-42bf-9320-5a24e584d279 tempest-VolumesCloneTest-1583605925 None] Lock "cinder-quobyte-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1" released by "delete_volume" :: held 0.687s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:07 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-7116d30a-55df-42bf-9320-5a24e584d279 tempest-VolumesCloneTest-1583605925 None] Created reservations ['724a8f80-f051-43f1-a4fe-a2487bcbd9cb', '38bdbe7a-bc79-4226-8b00-da7a43af2028', '701614ee-c4ec-4b06-bd92-07750d3bde79', 'b508f8bf-4943-4254-a99f-d6abe8d044e2'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7116d30a-55df-42bf-9320-5a24e584d279 tempest-VolumesCloneTest-1583605925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7116d30a-55df-42bf-9320-5a24e584d279 tempest-VolumesCloneTest-1583605925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:07 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7116d30a-55df-42bf-9320-5a24e584d279 tempest-VolumesCloneTest-1583605925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:07 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7116d30a-55df-42bf-9320-5a24e584d279 tempest-VolumesCloneTest-1583605925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7116d30a-55df-42bf-9320-5a24e584d279 tempest-VolumesCloneTest-1583605925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7116d30a-55df-42bf-9320-5a24e584d279 tempest-VolumesCloneTest-1583605925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:07 devstack sudo[100694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:41:07 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:07 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7116d30a-55df-42bf-9320-5a24e584d279 tempest-VolumesCloneTest-1583605925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.251s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:07 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-7116d30a-55df-42bf-9320-5a24e584d279 tempest-VolumesCloneTest-1583605925 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:41:07 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-7116d30a-55df-42bf-9320-5a24e584d279 tempest-VolumesCloneTest-1583605925 None] Deleted volume successfully.
Nov 07 02:41:07 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-fe0f3bf9-947c-4c11-a1f8-c724217e2879 tempest-GroupSnapshotsTest-1518963210 None] Update group completed successfully.
Nov 07 02:41:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7116d30a-55df-42bf-9320-5a24e584d279 tempest-VolumesCloneTest-1583605925 None] Lock "cinder-1b49c9b1-2ab4-4a4c-9b3a-98e895c405a1-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:08 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-62c4ccc4-78ff-43a1-b27a-573fa258e3c8 tempest-GroupSnapshotsTest-1518963210 None] Update group completed successfully.
Nov 07 02:41:09 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-00d90f16-70b7-4121-b2da-e7b10d782dd1 tempest-GroupSnapshotsTest-1518963210 None] Update group completed successfully.
Nov 07 02:41:11 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-6fd22d12-d079-498f-842c-bb247a39a8ae tempest-GroupSnapshotsTest-1518963210 None] Update group completed successfully.
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Flow 'volume_create_manager' (997101ee-96e6-4057-83ae-085391bc954f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9dbf8bd-de31-4eea-bfc9-4968dfaee520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9dbf8bd-de31-4eea-bfc9-4968dfaee520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1146046959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31dfb67c-2d44-4e9d-96ca-705d0af9d99c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c28cff18aa8b4ba5b13f1a1f55eba115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:11Z,use_quota=True,user_id='7c57a575d9394a89aa23262327ae7366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eebbfe80-1db2-44c2-abbd-297018dcbe25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eebbfe80-1db2-44c2-abbd-297018dcbe25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe8977b-fac4-4154-a80b-e6cfad272cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe8977b-fac4-4154-a80b-e6cfad272cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31dfb67c-2d44-4e9d-96ca-705d0af9d99c', 'volume_name': 'volume-31dfb67c-2d44-4e9d-96ca-705d0af9d99c', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5cc7e0-a457-4f97-aa75-6befdd57e8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5cc7e0-a457-4f97-aa75-6befdd57e8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703d97d2-874d-4df9-be83-769414ca3048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:11 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Volume 31dfb67c-2d44-4e9d-96ca-705d0af9d99c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31dfb67c-2d44-4e9d-96ca-705d0af9d99c', 'volume_size': 1}
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1146046959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31dfb67c-2d44-4e9d-96ca-705d0af9d99c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c28cff18aa8b4ba5b13f1a1f55eba115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:11Z,use_quota=True,user_id='7c57a575d9394a89aa23262327ae7366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Creating volume 31dfb67c-2d44-4e9d-96ca-705d0af9d99c {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:41:11 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-31dfb67c-2d44-4e9d-96ca-705d0af9d99c 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:11 devstack sudo[100698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-31dfb67c-2d44-4e9d-96ca-705d0af9d99c 1073741824
Nov 07 02:41:11 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:11 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-31dfb67c-2d44-4e9d-96ca-705d0af9d99c 1073741824" returned: 0 in 0.394s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-31dfb67c-2d44-4e9d-96ca-705d0af9d99c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:11 devstack sudo[100704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-31dfb67c-2d44-4e9d-96ca-705d0af9d99c
Nov 07 02:41:11 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:11 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-31dfb67c-2d44-4e9d-96ca-705d0af9d99c" returned: 0 in 0.245s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:41:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703d97d2-874d-4df9-be83-769414ca3048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31dfb67c-2d44-4e9d-96ca-705d0af9d99c', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f45bee5a-9a69-466d-8501-1c660fecf783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:12 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Volume volume-31dfb67c-2d44-4e9d-96ca-705d0af9d99c (31dfb67c-2d44-4e9d-96ca-705d0af9d99c): created successfully
Nov 07 02:41:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f45bee5a-9a69-466d-8501-1c660fecf783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Flow 'volume_create_manager' (997101ee-96e6-4057-83ae-085391bc954f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:12 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c99d6b03-4998-48ce-8bdb-2670b91c0e7b tempest-VolumesListTestJSON-1577174379 None] Created volume successfully.
Nov 07 02:41:12 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] GroupSnapshot 9e08e7ea-48ad-4f73-8a43-04f436b2fb66: creating.
Nov 07 02:41:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] Group snapshot 9e08e7ea-48ad-4f73-8a43-04f436b2fb66: creating. {{(pid=87054) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 07 02:41:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] Creating offline snapshot 45944bc9-8c6a-4943-8f0e-bf3baf15d2ed of volume 9103639a-7a35-42b3-948a-c00fae258b75 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:41:12 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:41:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Flow 'volume_create_manager' (4ff8605d-a914-4ca3-a89c-d9e8f23434c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd402fe-d6b2-4484-8a48-445db174a1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:12 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d9f087-7393-4f20-a3d8-0eaecacedacb]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd402fe-d6b2-4484-8a48-445db174a1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1901046877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c28cff18aa8b4ba5b13f1a1f55eba115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:13Z,use_quota=True,user_id='7c57a575d9394a89aa23262327ae7366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e0d2e4-8726-4445-8d15-74f272a1c1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e0d2e4-8726-4445-8d15-74f272a1c1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f58a0291-d772-43af-8ebd-d980528269b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f58a0291-d772-43af-8ebd-d980528269b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552', 'volume_name': 'volume-f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7a20dc-0a49-44b7-8d69-d367ee17e587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7a20dc-0a49-44b7-8d69-d367ee17e587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6dbc24-efdd-49ce-9e74-4280a896c22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:12 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Volume f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552', 'volume_size': 1}
Nov 07 02:41:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:12 devstack sudo[100711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75
Nov 07 02:41:12 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:13 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75" returned: 0 in 0.440s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.45944bc9-8c6a-4943-8f0e-bf3baf15d2ed 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:13 devstack sudo[100717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.45944bc9-8c6a-4943-8f0e-bf3baf15d2ed 1G
Nov 07 02:41:13 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:13 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.45944bc9-8c6a-4943-8f0e-bf3baf15d2ed 1G" returned: 0 in 0.489s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9103639a-7a35-42b3-948a-c00fae258b75 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.45944bc9-8c6a-4943-8f0e-bf3baf15d2ed {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:13 devstack sudo[100726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9103639a-7a35-42b3-948a-c00fae258b75 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.45944bc9-8c6a-4943-8f0e-bf3baf15d2ed
Nov 07 02:41:13 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:14 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9103639a-7a35-42b3-948a-c00fae258b75 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.45944bc9-8c6a-4943-8f0e-bf3baf15d2ed" returned: 0 in 0.371s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:14 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.45944bc9-8c6a-4943-8f0e-bf3baf15d2ed is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:41:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.45944bc9-8c6a-4943-8f0e-bf3baf15d2ed {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:14 devstack sudo[100732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.45944bc9-8c6a-4943-8f0e-bf3baf15d2ed
Nov 07 02:41:14 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:14 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.45944bc9-8c6a-4943-8f0e-bf3baf15d2ed" returned: 0 in 0.385s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:14 devstack sudo[100756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.info
Nov 07 02:41:14 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:14 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.info" returned: 0 in 0.306s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:14 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:41:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:14 devstack sudo[100764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.info
Nov 07 02:41:14 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:15 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.info" returned: 0 in 0.252s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.375s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] Creating offline snapshot bddec9db-c330-4f99-901e-3a94f3513893 of volume 2aeb46de-0e4b-4d7a-b67d-cbda9992b918 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:41:15 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fe31ba-2222-47f8-b440-04a0efe1f8f8]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:15 devstack sudo[100767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918
Nov 07 02:41:15 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:15 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-5948aded-2e7e-4a1b-ab7d-c58e976bd777 req-fd6f6692-9315-4d56-955d-ee1b5e5ddfc5 tempest-TestShelveInstance-1331364886 None] Terminate volume connection completed successfully.
Nov 07 02:41:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-5948aded-2e7e-4a1b-ab7d-c58e976bd777 req-fd6f6692-9315-4d56-955d-ee1b5e5ddfc5 tempest-TestShelveInstance-1331364886 None] Deleting attachment ecf128c9-6162-4a67-b00e-3ee95d4cdd44. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:41:15 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918" returned: 0 in 0.419s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.bddec9db-c330-4f99-901e-3a94f3513893 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:15 devstack sudo[100774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.bddec9db-c330-4f99-901e-3a94f3513893 1G
Nov 07 02:41:15 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-5948aded-2e7e-4a1b-ab7d-c58e976bd777 req-c2a1194b-1c8b-48d2-8109-893bfa850958 tempest-TestShelveInstance-1331364886 None] Acquiring lock "cinder-ea18f68a-84f7-4572-a19a-d43c14ca6701-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-5948aded-2e7e-4a1b-ab7d-c58e976bd777 req-c2a1194b-1c8b-48d2-8109-893bfa850958 tempest-TestShelveInstance-1331364886 None] Lock "cinder-ea18f68a-84f7-4572-a19a-d43c14ca6701-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-5948aded-2e7e-4a1b-ab7d-c58e976bd777 req-c2a1194b-1c8b-48d2-8109-893bfa850958 tempest-TestShelveInstance-1331364886 None] Acquiring lock "cinder-quobyte-ea18f68a-84f7-4572-a19a-d43c14ca6701" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-5948aded-2e7e-4a1b-ab7d-c58e976bd777 req-c2a1194b-1c8b-48d2-8109-893bfa850958 tempest-TestShelveInstance-1331364886 None] Lock "cinder-quobyte-ea18f68a-84f7-4572-a19a-d43c14ca6701" acquired by "delete_volume" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:15 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[a574311a-2b5c-49df-8a4e-98d251695da1]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-5948aded-2e7e-4a1b-ab7d-c58e976bd777 req-c2a1194b-1c8b-48d2-8109-893bfa850958 tempest-TestShelveInstance-1331364886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ea18f68a-84f7-4572-a19a-d43c14ca6701 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:15 devstack sudo[100776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ea18f68a-84f7-4572-a19a-d43c14ca6701
Nov 07 02:41:15 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:16 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.bddec9db-c330-4f99-901e-3a94f3513893 1G" returned: 0 in 0.495s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.bddec9db-c330-4f99-901e-3a94f3513893 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:16 devstack sudo[100781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.bddec9db-c330-4f99-901e-3a94f3513893
Nov 07 02:41:16 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:16 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-5948aded-2e7e-4a1b-ab7d-c58e976bd777 req-c2a1194b-1c8b-48d2-8109-893bfa850958 tempest-TestShelveInstance-1331364886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ea18f68a-84f7-4572-a19a-d43c14ca6701" returned: 0 in 0.435s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-5948aded-2e7e-4a1b-ab7d-c58e976bd777 req-c2a1194b-1c8b-48d2-8109-893bfa850958 tempest-TestShelveInstance-1331364886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ea18f68a-84f7-4572-a19a-d43c14ca6701 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:16 devstack sudo[100786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ea18f68a-84f7-4572-a19a-d43c14ca6701
Nov 07 02:41:16 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:16 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.bddec9db-c330-4f99-901e-3a94f3513893" returned: 0 in 0.330s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:16 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.bddec9db-c330-4f99-901e-3a94f3513893 is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:41:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.bddec9db-c330-4f99-901e-3a94f3513893 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:16 devstack sudo[100791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.bddec9db-c330-4f99-901e-3a94f3513893
Nov 07 02:41:16 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:16 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-5948aded-2e7e-4a1b-ab7d-c58e976bd777 req-c2a1194b-1c8b-48d2-8109-893bfa850958 tempest-TestShelveInstance-1331364886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ea18f68a-84f7-4572-a19a-d43c14ca6701" returned: 0 in 0.282s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-5948aded-2e7e-4a1b-ab7d-c58e976bd777 req-c2a1194b-1c8b-48d2-8109-893bfa850958 tempest-TestShelveInstance-1331364886 None] Lock "cinder-quobyte-ea18f68a-84f7-4572-a19a-d43c14ca6701" released by "delete_volume" :: held 0.773s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:16 devstack cinder-volume[87054]: DEBUG cinder.quota [req-5948aded-2e7e-4a1b-ab7d-c58e976bd777 req-c2a1194b-1c8b-48d2-8109-893bfa850958 tempest-TestShelveInstance-1331364886 None] Created reservations ['3aafe4aa-722c-46cb-a48a-a9e2d7096097', '7dc44405-1387-43fe-ba20-187cb8b5bed8', '296f976e-54ae-444e-a880-0cfde12c72f5', '4388ae91-6125-43bd-8db7-ccebe2b5d8fe'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-5948aded-2e7e-4a1b-ab7d-c58e976bd777 req-c2a1194b-1c8b-48d2-8109-893bfa850958 tempest-TestShelveInstance-1331364886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-5948aded-2e7e-4a1b-ab7d-c58e976bd777 req-c2a1194b-1c8b-48d2-8109-893bfa850958 tempest-TestShelveInstance-1331364886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [req-5948aded-2e7e-4a1b-ab7d-c58e976bd777 req-c2a1194b-1c8b-48d2-8109-893bfa850958 tempest-TestShelveInstance-1331364886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [req-5948aded-2e7e-4a1b-ab7d-c58e976bd777 req-c2a1194b-1c8b-48d2-8109-893bfa850958 tempest-TestShelveInstance-1331364886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-5948aded-2e7e-4a1b-ab7d-c58e976bd777 req-c2a1194b-1c8b-48d2-8109-893bfa850958 tempest-TestShelveInstance-1331364886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-5948aded-2e7e-4a1b-ab7d-c58e976bd777 req-c2a1194b-1c8b-48d2-8109-893bfa850958 tempest-TestShelveInstance-1331364886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:16 devstack sudo[100794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:41:16 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:16 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.bddec9db-c330-4f99-901e-3a94f3513893" returned: 0 in 0.282s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:16 devstack sudo[100797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.info
Nov 07 02:41:16 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:16 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [req-5948aded-2e7e-4a1b-ab7d-c58e976bd777 req-c2a1194b-1c8b-48d2-8109-893bfa850958 tempest-TestShelveInstance-1331364886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.330s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:16 devstack cinder-volume[87054]: DEBUG cinder.manager [req-5948aded-2e7e-4a1b-ab7d-c58e976bd777 req-c2a1194b-1c8b-48d2-8109-893bfa850958 tempest-TestShelveInstance-1331364886 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:41:16 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-5948aded-2e7e-4a1b-ab7d-c58e976bd777 req-c2a1194b-1c8b-48d2-8109-893bfa850958 tempest-TestShelveInstance-1331364886 None] Deleted volume successfully.
Nov 07 02:41:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [req-5948aded-2e7e-4a1b-ab7d-c58e976bd777 req-c2a1194b-1c8b-48d2-8109-893bfa850958 tempest-TestShelveInstance-1331364886 None] Lock "cinder-ea18f68a-84f7-4572-a19a-d43c14ca6701-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:17 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.info" returned: 0 in 0.382s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:17 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:41:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:17 devstack sudo[100801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.info
Nov 07 02:41:17 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:17 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.info" returned: 0 in 0.245s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.251s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.485s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1901046877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c28cff18aa8b4ba5b13f1a1f55eba115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:13Z,use_quota=True,user_id='7c57a575d9394a89aa23262327ae7366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:41:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Creating volume f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:41:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:41:17 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:41:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:17 devstack sudo[100804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552 1073741824
Nov 07 02:41:17 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:17 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-98f50b32-541e-455a-886e-02b9f7bc8ed8 tempest-GroupSnapshotsTest-1518963210 None] group_snapshot 9e08e7ea-48ad-4f73-8a43-04f436b2fb66: created successfully
Nov 07 02:41:17 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552 1073741824" returned: 0 in 0.489s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:17 devstack sudo[100811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552
Nov 07 02:41:17 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:18 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:18 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] group_snapshot 9e08e7ea-48ad-4f73-8a43-04f436b2fb66: deleting
Nov 07 02:41:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552" returned: 0 in 0.307s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:18 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:41:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] group_snapshot 9e08e7ea-48ad-4f73-8a43-04f436b2fb66: deleting {{(pid=87054) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 07 02:41:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6dbc24-efdd-49ce-9e74-4280a896c22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a10221b-e433-43eb-b85c-42f8bdbea042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:18 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Volume volume-f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552 (f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552): created successfully
Nov 07 02:41:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a10221b-e433-43eb-b85c-42f8bdbea042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Flow 'volume_create_manager' (4ff8605d-a914-4ca3-a89c-d9e8f23434c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "cinder-quobyte-9103639a-7a35-42b3-948a-c00fae258b75" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:18 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-dd191e4f-e250-49f7-a020-924d4662d6fa tempest-VolumesListTestJSON-1577174379 None] Created volume successfully.
Nov 07 02:41:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-9103639a-7a35-42b3-948a-c00fae258b75" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "cinder-quobyte-45944bc9-8c6a-4943-8f0e-bf3baf15d2ed" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-45944bc9-8c6a-4943-8f0e-bf3baf15d2ed" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:18 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Deleting offline snapshot 45944bc9-8c6a-4943-8f0e-bf3baf15d2ed of volume 9103639a-7a35-42b3-948a-c00fae258b75 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:41:18 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] snapshot_file for this snap is: volume-9103639a-7a35-42b3-948a-c00fae258b75.45944bc9-8c6a-4943-8f0e-bf3baf15d2ed {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:41:18 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[5197fc90-dad8-493b-ac2b-a578acf9010b]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.45944bc9-8c6a-4943-8f0e-bf3baf15d2ed {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:18 devstack sudo[100814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.45944bc9-8c6a-4943-8f0e-bf3baf15d2ed
Nov 07 02:41:18 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:18 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.45944bc9-8c6a-4943-8f0e-bf3baf15d2ed" returned: 0 in 0.407s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:18 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9103639a-7a35-42b3-948a-c00fae258b75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:41:18 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7e37ae-806a-47c7-baa9-a246ac6135cb]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:18 devstack sudo[100820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75
Nov 07 02:41:18 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:19 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75" returned: 0 in 0.393s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.45944bc9-8c6a-4943-8f0e-bf3baf15d2ed {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:19 devstack sudo[100825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.45944bc9-8c6a-4943-8f0e-bf3baf15d2ed
Nov 07 02:41:19 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:19 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.45944bc9-8c6a-4943-8f0e-bf3baf15d2ed" returned: 0 in 0.410s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.45944bc9-8c6a-4943-8f0e-bf3baf15d2ed {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:19 devstack sudo[100830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.45944bc9-8c6a-4943-8f0e-bf3baf15d2ed
Nov 07 02:41:19 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Flow 'volume_create_manager' (ff30ae9d-094d-4f67-a143-bd68415e1a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f82fde-a409-4ed9-902b-00200ed7a47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f82fde-a409-4ed9-902b-00200ed7a47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-119927936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d12bca7-24b5-450a-b96b-2646bccfa232,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c28cff18aa8b4ba5b13f1a1f55eba115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:20Z,use_quota=True,user_id='7c57a575d9394a89aa23262327ae7366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c35b321-f492-407a-8425-1b94d7004fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c35b321-f492-407a-8425-1b94d7004fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e9b1408-09fa-4591-ae92-133b958da0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e9b1408-09fa-4591-ae92-133b958da0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d12bca7-24b5-450a-b96b-2646bccfa232', 'volume_name': 'volume-0d12bca7-24b5-450a-b96b-2646bccfa232', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149df3d2-e66a-46f9-8922-8fa9c93d5375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149df3d2-e66a-46f9-8922-8fa9c93d5375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3254a53c-a48a-49b2-8af9-72644bcd685b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:19 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Volume 0d12bca7-24b5-450a-b96b-2646bccfa232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d12bca7-24b5-450a-b96b-2646bccfa232', 'volume_size': 1}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-119927936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d12bca7-24b5-450a-b96b-2646bccfa232,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c28cff18aa8b4ba5b13f1a1f55eba115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:20Z,use_quota=True,user_id='7c57a575d9394a89aa23262327ae7366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Creating volume 0d12bca7-24b5-450a-b96b-2646bccfa232 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:41:19 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0d12bca7-24b5-450a-b96b-2646bccfa232 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:19 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75.45944bc9-8c6a-4943-8f0e-bf3baf15d2ed" returned: 0 in 0.277s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:19 devstack sudo[100834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0d12bca7-24b5-450a-b96b-2646bccfa232 1073741824
Nov 07 02:41:19 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-45944bc9-8c6a-4943-8f0e-bf3baf15d2ed" released by "_delete_snapshot" :: held 1.608s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-9103639a-7a35-42b3-948a-c00fae258b75" released by "delete_snapshot" :: held 1.636s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "cinder-quobyte-2aeb46de-0e4b-4d7a-b67d-cbda9992b918" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-2aeb46de-0e4b-4d7a-b67d-cbda9992b918" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "cinder-quobyte-bddec9db-c330-4f99-901e-3a94f3513893" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-bddec9db-c330-4f99-901e-3a94f3513893" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Deleting offline snapshot bddec9db-c330-4f99-901e-3a94f3513893 of volume 2aeb46de-0e4b-4d7a-b67d-cbda9992b918 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] snapshot_file for this snap is: volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.bddec9db-c330-4f99-901e-3a94f3513893 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32c6961-7833-4ca8-a80e-2ef24a959e64]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.bddec9db-c330-4f99-901e-3a94f3513893 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:20 devstack sudo[100836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.bddec9db-c330-4f99-901e-3a94f3513893
Nov 07 02:41:20 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:20 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0d12bca7-24b5-450a-b96b-2646bccfa232 1073741824" returned: 0 in 0.481s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0d12bca7-24b5-450a-b96b-2646bccfa232 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:20 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.bddec9db-c330-4f99-901e-3a94f3513893" returned: 0 in 0.390s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:41:20 devstack sudo[100845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0d12bca7-24b5-450a-b96b-2646bccfa232
Nov 07 02:41:20 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:20 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae3b467-f535-47b8-80d5-3a71cf5cce3d]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:20 devstack sudo[100847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918
Nov 07 02:41:20 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:20 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0d12bca7-24b5-450a-b96b-2646bccfa232" returned: 0 in 0.367s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:41:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3254a53c-a48a-49b2-8af9-72644bcd685b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d12bca7-24b5-450a-b96b-2646bccfa232', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e73fc36-db6c-4af4-9d56-dbfb867b1190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:20 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Volume volume-0d12bca7-24b5-450a-b96b-2646bccfa232 (0d12bca7-24b5-450a-b96b-2646bccfa232): created successfully
Nov 07 02:41:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e73fc36-db6c-4af4-9d56-dbfb867b1190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Flow 'volume_create_manager' (ff30ae9d-094d-4f67-a143-bd68415e1a38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:20 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c662781f-fd42-4a46-b6f5-d7a52bffd98c tempest-VolumesListTestJSON-1577174379 None] Created volume successfully.
Nov 07 02:41:20 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918" returned: 0 in 0.512s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.bddec9db-c330-4f99-901e-3a94f3513893 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:20 devstack sudo[100853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.bddec9db-c330-4f99-901e-3a94f3513893
Nov 07 02:41:20 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:21 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.bddec9db-c330-4f99-901e-3a94f3513893" returned: 0 in 0.367s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.bddec9db-c330-4f99-901e-3a94f3513893 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:21 devstack sudo[100858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.bddec9db-c330-4f99-901e-3a94f3513893
Nov 07 02:41:21 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:21 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918.bddec9db-c330-4f99-901e-3a94f3513893" returned: 0 in 0.277s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-bddec9db-c330-4f99-901e-3a94f3513893" released by "_delete_snapshot" :: held 1.671s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-2aeb46de-0e4b-4d7a-b67d-cbda9992b918" released by "delete_snapshot" :: held 1.696s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:21 devstack cinder-volume[87054]: WARNING cinder.quota [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1129160280 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1129160280, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:41:21 devstack cinder-volume[87054]: WARNING cinder.quota [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1129160280 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1129160280, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:41:21 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Created reservations ['1c0fc7fb-83f8-4c77-b5c4-c19c642f0d5a', '52f081db-fe98-48e2-896b-72cffbd20b89', 'f5d6d369-e74a-4e05-b118-f738200e4ece', '2401abcf-99be-41d3-966c-a02503fd6278'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:21 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] Created reservations ['73d5b91c-f817-4579-93b9-c4f0fc5030b0', '3dd0a2e6-7bba-4a5c-9dec-bc1625e7f3df', '5af6b581-5336-423e-9d77-25a109aa4f9a', 'faa9c270-3647-4af3-8633-c61e94598875'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:21 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-9e1e814f-3a3f-4e99-9d46-5fea764063a4 tempest-GroupSnapshotsTest-1518963210 None] group_snapshot 9e08e7ea-48ad-4f73-8a43-04f436b2fb66: deleted successfully
Nov 07 02:41:23 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "cinder-quobyte-2aeb46de-0e4b-4d7a-b67d-cbda9992b918" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:23 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-2aeb46de-0e4b-4d7a-b67d-cbda9992b918" acquired by "delete_volume" :: waited 0.024s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:23 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b92984-6ab8-4da3-b27b-5a26e04af303]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:23 devstack sudo[100863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918
Nov 07 02:41:23 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:23 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918" returned: 0 in 0.441s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:23 devstack sudo[100868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918
Nov 07 02:41:23 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:24 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2aeb46de-0e4b-4d7a-b67d-cbda9992b918" returned: 0 in 0.321s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-2aeb46de-0e4b-4d7a-b67d-cbda9992b918" released by "delete_volume" :: held 0.848s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "cinder-quobyte-9103639a-7a35-42b3-948a-c00fae258b75" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-9103639a-7a35-42b3-948a-c00fae258b75" acquired by "delete_volume" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:24 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfeb3a41-8b61-4bac-97f1-afd65c284c88]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f15ae78f-0fab-453b-a61f-8a23f228dc5a tempest-VolumesListTestJSON-1577174379 None] Acquiring lock "cinder-0d12bca7-24b5-450a-b96b-2646bccfa232-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f15ae78f-0fab-453b-a61f-8a23f228dc5a tempest-VolumesListTestJSON-1577174379 None] Lock "cinder-0d12bca7-24b5-450a-b96b-2646bccfa232-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f15ae78f-0fab-453b-a61f-8a23f228dc5a tempest-VolumesListTestJSON-1577174379 None] Acquiring lock "cinder-quobyte-0d12bca7-24b5-450a-b96b-2646bccfa232" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f15ae78f-0fab-453b-a61f-8a23f228dc5a tempest-VolumesListTestJSON-1577174379 None] Lock "cinder-quobyte-0d12bca7-24b5-450a-b96b-2646bccfa232" acquired by "delete_volume" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:24 devstack sudo[100871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75
Nov 07 02:41:24 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:24 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb08e56-bc76-4423-a0c8-b090ca7b9191]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f15ae78f-0fab-453b-a61f-8a23f228dc5a tempest-VolumesListTestJSON-1577174379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0d12bca7-24b5-450a-b96b-2646bccfa232 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:24 devstack sudo[100873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0d12bca7-24b5-450a-b96b-2646bccfa232
Nov 07 02:41:24 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:24 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75" returned: 0 in 0.415s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:24 devstack sudo[100878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75
Nov 07 02:41:24 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:24 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f15ae78f-0fab-453b-a61f-8a23f228dc5a tempest-VolumesListTestJSON-1577174379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0d12bca7-24b5-450a-b96b-2646bccfa232" returned: 0 in 0.395s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f15ae78f-0fab-453b-a61f-8a23f228dc5a tempest-VolumesListTestJSON-1577174379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0d12bca7-24b5-450a-b96b-2646bccfa232 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:24 devstack sudo[100883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0d12bca7-24b5-450a-b96b-2646bccfa232
Nov 07 02:41:24 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:24 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9103639a-7a35-42b3-948a-c00fae258b75" returned: 0 in 0.272s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-9103639a-7a35-42b3-948a-c00fae258b75" released by "delete_volume" :: held 0.763s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:24 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f15ae78f-0fab-453b-a61f-8a23f228dc5a tempest-VolumesListTestJSON-1577174379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0d12bca7-24b5-450a-b96b-2646bccfa232" returned: 0 in 0.274s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f15ae78f-0fab-453b-a61f-8a23f228dc5a tempest-VolumesListTestJSON-1577174379 None] Lock "cinder-quobyte-0d12bca7-24b5-450a-b96b-2646bccfa232" released by "delete_volume" :: held 0.732s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] Created reservations ['7904b999-9f3a-47e8-a56b-685d753735e8'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-f15ae78f-0fab-453b-a61f-8a23f228dc5a tempest-VolumesListTestJSON-1577174379 None] Created reservations ['763814f0-60e4-44ad-8a9c-c47de67d297e', 'c0ee8898-8c66-4e6b-abd9-2a01e19d0f04', '173239ff-26f0-45c8-8d44-b9a851e4936c', 'ec26cae7-db6d-4bf8-8d9a-b056c0c3d000'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:25 devstack cinder-volume[87054]: WARNING cinder.quota [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1129160280 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1129160280, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] Created reservations ['f1177c90-2a64-4fa6-a0f5-7bad346ae2de', '823b7d71-4c61-4f3f-99a9-739ad7690b84', '3d6a2eb0-22b8-43f9-a244-fe4dd3286704', '92120bf6-082b-4e23-9b13-c88825f90fbd'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f15ae78f-0fab-453b-a61f-8a23f228dc5a tempest-VolumesListTestJSON-1577174379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f15ae78f-0fab-453b-a61f-8a23f228dc5a tempest-VolumesListTestJSON-1577174379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f15ae78f-0fab-453b-a61f-8a23f228dc5a tempest-VolumesListTestJSON-1577174379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f15ae78f-0fab-453b-a61f-8a23f228dc5a tempest-VolumesListTestJSON-1577174379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f15ae78f-0fab-453b-a61f-8a23f228dc5a tempest-VolumesListTestJSON-1577174379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f15ae78f-0fab-453b-a61f-8a23f228dc5a tempest-VolumesListTestJSON-1577174379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:25 devstack sudo[100887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:41:25 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] Created reservations ['3546c65d-94c4-49c2-afd2-dfc11deae180', '413b4169-eace-4791-b52e-0857207ec2c8', 'cb0b495e-85f1-4116-a552-1729e81456e1', 'a9a583e8-ed4b-4ed4-a4a1-17ce84d664e6'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-16d6e6b5-ff77-43a6-a774-0ca8cfd6ba0f tempest-VolumesListTestJSON-1577174379 None] Acquiring lock "cinder-f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-16d6e6b5-ff77-43a6-a774-0ca8cfd6ba0f tempest-VolumesListTestJSON-1577174379 None] Lock "cinder-f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:25 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:25 devstack sudo[100890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:41:25 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f15ae78f-0fab-453b-a61f-8a23f228dc5a tempest-VolumesListTestJSON-1577174379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.328s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-f15ae78f-0fab-453b-a61f-8a23f228dc5a tempest-VolumesListTestJSON-1577174379 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-16d6e6b5-ff77-43a6-a774-0ca8cfd6ba0f tempest-VolumesListTestJSON-1577174379 None] Acquiring lock "cinder-quobyte-f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:25 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f15ae78f-0fab-453b-a61f-8a23f228dc5a tempest-VolumesListTestJSON-1577174379 None] Deleted volume successfully.
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-16d6e6b5-ff77-43a6-a774-0ca8cfd6ba0f tempest-VolumesListTestJSON-1577174379 None] Lock "cinder-quobyte-f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552" acquired by "delete_volume" :: waited 0.029s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f15ae78f-0fab-453b-a61f-8a23f228dc5a tempest-VolumesListTestJSON-1577174379 None] Lock "cinder-0d12bca7-24b5-450a-b96b-2646bccfa232-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd1c834-1dbf-49d3-a088-e85f887d19d4]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-16d6e6b5-ff77-43a6-a774-0ca8cfd6ba0f tempest-VolumesListTestJSON-1577174379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:25 devstack sudo[100892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552
Nov 07 02:41:25 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:25 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.368s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:25 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:41:25 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-2f5c757e-4da2-4435-bd49-54efdf443837 tempest-GroupSnapshotsTest-1518963210 None] Delete group completed successfully.
Nov 07 02:41:26 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-16d6e6b5-ff77-43a6-a774-0ca8cfd6ba0f tempest-VolumesListTestJSON-1577174379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552" returned: 0 in 0.525s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-16d6e6b5-ff77-43a6-a774-0ca8cfd6ba0f tempest-VolumesListTestJSON-1577174379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:26 devstack sudo[100899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552
Nov 07 02:41:26 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:26 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-5d3dc6c9-51cb-4870-9e0e-8bbe2b8338aa tempest-GroupSnapshotsTest-1518963210 None] Group tempest-GroupSnapshotsTest-Group-1200988080: creating
Nov 07 02:41:26 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-5d3dc6c9-51cb-4870-9e0e-8bbe2b8338aa tempest-GroupSnapshotsTest-1518963210 None] Group tempest-GroupSnapshotsTest-Group-1200988080: created successfully
Nov 07 02:41:26 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-5d3dc6c9-51cb-4870-9e0e-8bbe2b8338aa tempest-GroupSnapshotsTest-1518963210 None] Create group completed successfully.
Nov 07 02:41:26 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-16d6e6b5-ff77-43a6-a774-0ca8cfd6ba0f tempest-VolumesListTestJSON-1577174379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552" returned: 0 in 0.307s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-16d6e6b5-ff77-43a6-a774-0ca8cfd6ba0f tempest-VolumesListTestJSON-1577174379 None] Lock "cinder-quobyte-f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552" released by "delete_volume" :: held 0.904s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:26 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-16d6e6b5-ff77-43a6-a774-0ca8cfd6ba0f tempest-VolumesListTestJSON-1577174379 None] Created reservations ['74cceea6-8c63-4433-a6af-96136c38c29d', '3be7743b-9bf9-460d-8b6d-b9d4e3ae7f93', '09962d02-e86c-488c-a90d-69c646e03ba4', '60170b27-d1d6-4072-aec6-b1834455bbc3'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-16d6e6b5-ff77-43a6-a774-0ca8cfd6ba0f tempest-VolumesListTestJSON-1577174379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-16d6e6b5-ff77-43a6-a774-0ca8cfd6ba0f tempest-VolumesListTestJSON-1577174379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-16d6e6b5-ff77-43a6-a774-0ca8cfd6ba0f tempest-VolumesListTestJSON-1577174379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-16d6e6b5-ff77-43a6-a774-0ca8cfd6ba0f tempest-VolumesListTestJSON-1577174379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-16d6e6b5-ff77-43a6-a774-0ca8cfd6ba0f tempest-VolumesListTestJSON-1577174379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-16d6e6b5-ff77-43a6-a774-0ca8cfd6ba0f tempest-VolumesListTestJSON-1577174379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:26 devstack sudo[100902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:41:26 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:26 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-16d6e6b5-ff77-43a6-a774-0ca8cfd6ba0f tempest-VolumesListTestJSON-1577174379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.272s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:26 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-16d6e6b5-ff77-43a6-a774-0ca8cfd6ba0f tempest-VolumesListTestJSON-1577174379 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:41:26 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-16d6e6b5-ff77-43a6-a774-0ca8cfd6ba0f tempest-VolumesListTestJSON-1577174379 None] Deleted volume successfully.
Nov 07 02:41:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-16d6e6b5-ff77-43a6-a774-0ca8cfd6ba0f tempest-VolumesListTestJSON-1577174379 None] Lock "cinder-f3a378f2-47e3-4b0e-9c9f-cb0e4a0e6552-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8a0ac401-bfe7-4b04-8c75-f35fcb35f790 tempest-VolumesListTestJSON-1577174379 None] Acquiring lock "cinder-31dfb67c-2d44-4e9d-96ca-705d0af9d99c-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8a0ac401-bfe7-4b04-8c75-f35fcb35f790 tempest-VolumesListTestJSON-1577174379 None] Lock "cinder-31dfb67c-2d44-4e9d-96ca-705d0af9d99c-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:27 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Flow 'volume_create_manager' (2955005c-01cf-4bca-8c8d-58dbe9cc2c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3020dcd-7318-4df6-9ab6-f605a19398c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3020dcd-7318-4df6-9ab6-f605a19398c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-803305626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b8766fac-1585-42cb-9e55-8537cdb437e5,host='devstack@QuobyteHD#QuobyteHD',id=969a437b-2ede-4af7-a855-a76ca1b36601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a672e2dc0b824344988b0918aead1052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:28Z,use_quota=True,user_id='b8b1bec903184487b8bb977e91260e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2269fb0b-f1a9-4e1a-bfd1-ead4dbfb7a3d),volume_type_id=2269fb0b-f1a9-4e1a-bfd1-ead4dbfb7a3d)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa8bae4-694c-4938-95a6-16d29e6364bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa8bae4-694c-4938-95a6-16d29e6364bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fae68bc-5545-484b-8c43-3f8f27dca450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fae68bc-5545-484b-8c43-3f8f27dca450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '969a437b-2ede-4af7-a855-a76ca1b36601', 'volume_name': 'volume-969a437b-2ede-4af7-a855-a76ca1b36601', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (314309ee-7604-4a75-b40d-f474e507014f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (314309ee-7604-4a75-b40d-f474e507014f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a056602-9026-449a-8607-088584442eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:28 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Volume 969a437b-2ede-4af7-a855-a76ca1b36601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-969a437b-2ede-4af7-a855-a76ca1b36601', 'volume_size': 1}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b8766fac-1585-42cb-9e55-8537cdb437e5,created_at=2026-11-07T01:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-803305626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b8766fac-1585-42cb-9e55-8537cdb437e5,host='devstack@QuobyteHD#QuobyteHD',id=969a437b-2ede-4af7-a855-a76ca1b36601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a672e2dc0b824344988b0918aead1052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:28Z,use_quota=True,user_id='b8b1bec903184487b8bb977e91260e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2269fb0b-f1a9-4e1a-bfd1-ead4dbfb7a3d),volume_type_id=2269fb0b-f1a9-4e1a-bfd1-ead4dbfb7a3d)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Creating volume 969a437b-2ede-4af7-a855-a76ca1b36601 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:41:28 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8a0ac401-bfe7-4b04-8c75-f35fcb35f790 tempest-VolumesListTestJSON-1577174379 None] Acquiring lock "cinder-quobyte-31dfb67c-2d44-4e9d-96ca-705d0af9d99c" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:28 devstack sudo[100906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601 1073741824
Nov 07 02:41:28 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8a0ac401-bfe7-4b04-8c75-f35fcb35f790 tempest-VolumesListTestJSON-1577174379 None] Lock "cinder-quobyte-31dfb67c-2d44-4e9d-96ca-705d0af9d99c" acquired by "delete_volume" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[128217e8-0913-4513-acdf-b69f0bfd7746]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8a0ac401-bfe7-4b04-8c75-f35fcb35f790 tempest-VolumesListTestJSON-1577174379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-31dfb67c-2d44-4e9d-96ca-705d0af9d99c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:28 devstack sudo[100908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-31dfb67c-2d44-4e9d-96ca-705d0af9d99c
Nov 07 02:41:28 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:28 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8a0ac401-bfe7-4b04-8c75-f35fcb35f790 tempest-VolumesListTestJSON-1577174379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-31dfb67c-2d44-4e9d-96ca-705d0af9d99c" returned: 0 in 0.414s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8a0ac401-bfe7-4b04-8c75-f35fcb35f790 tempest-VolumesListTestJSON-1577174379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-31dfb67c-2d44-4e9d-96ca-705d0af9d99c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:28 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601 1073741824" returned: 0 in 0.523s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:28 devstack sudo[100918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-31dfb67c-2d44-4e9d-96ca-705d0af9d99c
Nov 07 02:41:28 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:28 devstack sudo[100920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601
Nov 07 02:41:28 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:28 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8a0ac401-bfe7-4b04-8c75-f35fcb35f790 tempest-VolumesListTestJSON-1577174379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-31dfb67c-2d44-4e9d-96ca-705d0af9d99c" returned: 0 in 0.280s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8a0ac401-bfe7-4b04-8c75-f35fcb35f790 tempest-VolumesListTestJSON-1577174379 None] Lock "cinder-quobyte-31dfb67c-2d44-4e9d-96ca-705d0af9d99c" released by "delete_volume" :: held 0.762s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:28 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601" returned: 0 in 0.276s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a056602-9026-449a-8607-088584442eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-969a437b-2ede-4af7-a855-a76ca1b36601', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f028b3-65a5-4384-9628-10e264ebcb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:28 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Volume volume-969a437b-2ede-4af7-a855-a76ca1b36601 (969a437b-2ede-4af7-a855-a76ca1b36601): created successfully
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f028b3-65a5-4384-9628-10e264ebcb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Flow 'volume_create_manager' (2955005c-01cf-4bca-8c8d-58dbe9cc2c10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:29 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-8a0ac401-bfe7-4b04-8c75-f35fcb35f790 tempest-VolumesListTestJSON-1577174379 None] Created reservations ['a9f10085-2e8a-4302-b9c9-9bc88bd1b432', 'fd6ab94c-3146-48ee-9eb9-dbdcc54f8882', 'c9d832ac-13b0-442a-aa9e-bac8e3bf8196', '70e3cc4e-e205-44fa-87d5-6c7c1119e514'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:29 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-977c68e4-f57e-42cd-bb65-1c885460aab3 tempest-GroupSnapshotsTest-1518963210 None] Created volume successfully.
Nov 07 02:41:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8a0ac401-bfe7-4b04-8c75-f35fcb35f790 tempest-VolumesListTestJSON-1577174379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8a0ac401-bfe7-4b04-8c75-f35fcb35f790 tempest-VolumesListTestJSON-1577174379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8a0ac401-bfe7-4b04-8c75-f35fcb35f790 tempest-VolumesListTestJSON-1577174379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8a0ac401-bfe7-4b04-8c75-f35fcb35f790 tempest-VolumesListTestJSON-1577174379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8a0ac401-bfe7-4b04-8c75-f35fcb35f790 tempest-VolumesListTestJSON-1577174379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8a0ac401-bfe7-4b04-8c75-f35fcb35f790 tempest-VolumesListTestJSON-1577174379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:29 devstack sudo[100924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:41:29 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:29 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8a0ac401-bfe7-4b04-8c75-f35fcb35f790 tempest-VolumesListTestJSON-1577174379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.269s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:29 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-8a0ac401-bfe7-4b04-8c75-f35fcb35f790 tempest-VolumesListTestJSON-1577174379 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:41:29 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-8a0ac401-bfe7-4b04-8c75-f35fcb35f790 tempest-VolumesListTestJSON-1577174379 None] Deleted volume successfully.
Nov 07 02:41:29 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8a0ac401-bfe7-4b04-8c75-f35fcb35f790 tempest-VolumesListTestJSON-1577174379 None] Lock "cinder-31dfb67c-2d44-4e9d-96ca-705d0af9d99c-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:29 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-d79a0cf2-9958-4848-9b21-542448d7ca89 tempest-GroupSnapshotsTest-1518963210 None] GroupSnapshot 45c46e3b-eb51-4781-9ae0-116f4087caf3: creating.
Nov 07 02:41:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d79a0cf2-9958-4848-9b21-542448d7ca89 tempest-GroupSnapshotsTest-1518963210 None] Group snapshot 45c46e3b-eb51-4781-9ae0-116f4087caf3: creating. {{(pid=87054) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 07 02:41:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d79a0cf2-9958-4848-9b21-542448d7ca89 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d79a0cf2-9958-4848-9b21-542448d7ca89 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-d79a0cf2-9958-4848-9b21-542448d7ca89 tempest-GroupSnapshotsTest-1518963210 None] Creating offline snapshot 168a9211-b7d3-4f67-93a2-fd3339445739 of volume 969a437b-2ede-4af7-a855-a76ca1b36601 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:41:29 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1401129-0c8d-4d35-97ec-1529cd524282]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d79a0cf2-9958-4848-9b21-542448d7ca89 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:29 devstack sudo[100927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601
Nov 07 02:41:29 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:29 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d79a0cf2-9958-4848-9b21-542448d7ca89 tempest-GroupSnapshotsTest-1518963210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601" returned: 0 in 0.386s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d79a0cf2-9958-4848-9b21-542448d7ca89 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.168a9211-b7d3-4f67-93a2-fd3339445739 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:29 devstack sudo[100932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.168a9211-b7d3-4f67-93a2-fd3339445739 1G
Nov 07 02:41:29 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:30 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d79a0cf2-9958-4848-9b21-542448d7ca89 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.168a9211-b7d3-4f67-93a2-fd3339445739 1G" returned: 0 in 0.528s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d79a0cf2-9958-4848-9b21-542448d7ca89 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-969a437b-2ede-4af7-a855-a76ca1b36601 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.168a9211-b7d3-4f67-93a2-fd3339445739 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:30 devstack sudo[100937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-969a437b-2ede-4af7-a855-a76ca1b36601 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.168a9211-b7d3-4f67-93a2-fd3339445739
Nov 07 02:41:30 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:30 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d79a0cf2-9958-4848-9b21-542448d7ca89 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-969a437b-2ede-4af7-a855-a76ca1b36601 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.168a9211-b7d3-4f67-93a2-fd3339445739" returned: 0 in 0.402s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:30 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-d79a0cf2-9958-4848-9b21-542448d7ca89 tempest-GroupSnapshotsTest-1518963210 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.168a9211-b7d3-4f67-93a2-fd3339445739 is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:41:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d79a0cf2-9958-4848-9b21-542448d7ca89 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.168a9211-b7d3-4f67-93a2-fd3339445739 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:30 devstack sudo[100943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.168a9211-b7d3-4f67-93a2-fd3339445739
Nov 07 02:41:30 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:31 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d79a0cf2-9958-4848-9b21-542448d7ca89 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.168a9211-b7d3-4f67-93a2-fd3339445739" returned: 0 in 0.281s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d79a0cf2-9958-4848-9b21-542448d7ca89 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:31 devstack sudo[100946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.info
Nov 07 02:41:31 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:31 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d79a0cf2-9958-4848-9b21-542448d7ca89 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.info" returned: 0 in 0.303s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:31 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-d79a0cf2-9958-4848-9b21-542448d7ca89 tempest-GroupSnapshotsTest-1518963210 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 07 02:41:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d79a0cf2-9958-4848-9b21-542448d7ca89 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:31 devstack sudo[100949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.info
Nov 07 02:41:31 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:31 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d79a0cf2-9958-4848-9b21-542448d7ca89 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.info" returned: 0 in 0.310s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d79a0cf2-9958-4848-9b21-542448d7ca89 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.317s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:31 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-d79a0cf2-9958-4848-9b21-542448d7ca89 tempest-GroupSnapshotsTest-1518963210 None] group_snapshot 45c46e3b-eb51-4781-9ae0-116f4087caf3: created successfully
Nov 07 02:41:32 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c6cc86a5-8e18-4978-843b-07129dc58005 tempest-GroupSnapshotsTest-1518963210 None] group_snapshot 45c46e3b-eb51-4781-9ae0-116f4087caf3: deleting
Nov 07 02:41:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6cc86a5-8e18-4978-843b-07129dc58005 tempest-GroupSnapshotsTest-1518963210 None] group_snapshot 45c46e3b-eb51-4781-9ae0-116f4087caf3: deleting {{(pid=87054) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 07 02:41:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c6cc86a5-8e18-4978-843b-07129dc58005 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "cinder-quobyte-969a437b-2ede-4af7-a855-a76ca1b36601" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c6cc86a5-8e18-4978-843b-07129dc58005 tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-969a437b-2ede-4af7-a855-a76ca1b36601" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c6cc86a5-8e18-4978-843b-07129dc58005 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "cinder-quobyte-168a9211-b7d3-4f67-93a2-fd3339445739" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c6cc86a5-8e18-4978-843b-07129dc58005 tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-168a9211-b7d3-4f67-93a2-fd3339445739" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:32 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-c6cc86a5-8e18-4978-843b-07129dc58005 tempest-GroupSnapshotsTest-1518963210 None] Deleting offline snapshot 168a9211-b7d3-4f67-93a2-fd3339445739 of volume 969a437b-2ede-4af7-a855-a76ca1b36601 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:41:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-c6cc86a5-8e18-4978-843b-07129dc58005 tempest-GroupSnapshotsTest-1518963210 None] snapshot_file for this snap is: volume-969a437b-2ede-4af7-a855-a76ca1b36601.168a9211-b7d3-4f67-93a2-fd3339445739 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:41:33 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[320b38c9-8038-4547-9269-6d463f4b0154]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c6cc86a5-8e18-4978-843b-07129dc58005 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.168a9211-b7d3-4f67-93a2-fd3339445739 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:33 devstack sudo[100952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.168a9211-b7d3-4f67-93a2-fd3339445739
Nov 07 02:41:33 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:33 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c6cc86a5-8e18-4978-843b-07129dc58005 tempest-GroupSnapshotsTest-1518963210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.168a9211-b7d3-4f67-93a2-fd3339445739" returned: 0 in 0.470s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-c6cc86a5-8e18-4978-843b-07129dc58005 tempest-GroupSnapshotsTest-1518963210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-969a437b-2ede-4af7-a855-a76ca1b36601(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:41:33 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aba601a-baf8-440c-800d-a25f78570497]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c6cc86a5-8e18-4978-843b-07129dc58005 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:33 devstack sudo[100957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601
Nov 07 02:41:33 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:34 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c6cc86a5-8e18-4978-843b-07129dc58005 tempest-GroupSnapshotsTest-1518963210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601" returned: 0 in 0.455s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c6cc86a5-8e18-4978-843b-07129dc58005 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.168a9211-b7d3-4f67-93a2-fd3339445739 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:34 devstack sudo[100962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.168a9211-b7d3-4f67-93a2-fd3339445739
Nov 07 02:41:34 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:34 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c6cc86a5-8e18-4978-843b-07129dc58005 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.168a9211-b7d3-4f67-93a2-fd3339445739" returned: 0 in 0.483s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c6cc86a5-8e18-4978-843b-07129dc58005 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.168a9211-b7d3-4f67-93a2-fd3339445739 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:34 devstack sudo[100968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.168a9211-b7d3-4f67-93a2-fd3339445739
Nov 07 02:41:34 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:34 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c6cc86a5-8e18-4978-843b-07129dc58005 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601.168a9211-b7d3-4f67-93a2-fd3339445739" returned: 0 in 0.369s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c6cc86a5-8e18-4978-843b-07129dc58005 tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-168a9211-b7d3-4f67-93a2-fd3339445739" released by "_delete_snapshot" :: held 1.935s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c6cc86a5-8e18-4978-843b-07129dc58005 tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-969a437b-2ede-4af7-a855-a76ca1b36601" released by "delete_snapshot" :: held 1.971s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:35 devstack cinder-volume[87054]: WARNING cinder.quota [None req-c6cc86a5-8e18-4978-843b-07129dc58005 tempest-GroupSnapshotsTest-1518963210 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-854609395 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-854609395, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:41:35 devstack cinder-volume[87054]: WARNING cinder.quota [None req-c6cc86a5-8e18-4978-843b-07129dc58005 tempest-GroupSnapshotsTest-1518963210 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-854609395 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-854609395, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:41:35 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-c6cc86a5-8e18-4978-843b-07129dc58005 tempest-GroupSnapshotsTest-1518963210 None] Created reservations ['54b2cf21-a0a3-4ab3-8990-4d0a6e501158', '87ad1b42-63d3-4f97-9939-b09ca5f5d02c', 'e6e67050-5d93-4dd2-8151-16d1c6ea23c2', '02bdcc48-9f11-4260-9b8e-5ea414145cda'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:35 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c6cc86a5-8e18-4978-843b-07129dc58005 tempest-GroupSnapshotsTest-1518963210 None] group_snapshot 45c46e3b-eb51-4781-9ae0-116f4087caf3: deleted successfully
Nov 07 02:41:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1e7f9a32-aade-4626-8943-516249d39708 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "cinder-quobyte-969a437b-2ede-4af7-a855-a76ca1b36601" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1e7f9a32-aade-4626-8943-516249d39708 tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-969a437b-2ede-4af7-a855-a76ca1b36601" acquired by "delete_volume" :: waited 0.028s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:35 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[a961acc5-a610-4433-b077-7555719ffe20]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1e7f9a32-aade-4626-8943-516249d39708 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:36 devstack sudo[100971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601
Nov 07 02:41:36 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:36 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1e7f9a32-aade-4626-8943-516249d39708 tempest-GroupSnapshotsTest-1518963210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601" returned: 0 in 0.492s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1e7f9a32-aade-4626-8943-516249d39708 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:36 devstack sudo[100976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601
Nov 07 02:41:36 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:36 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1e7f9a32-aade-4626-8943-516249d39708 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-969a437b-2ede-4af7-a855-a76ca1b36601" returned: 0 in 0.289s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1e7f9a32-aade-4626-8943-516249d39708 tempest-GroupSnapshotsTest-1518963210 None] Lock "cinder-quobyte-969a437b-2ede-4af7-a855-a76ca1b36601" released by "delete_volume" :: held 0.895s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:36 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-1e7f9a32-aade-4626-8943-516249d39708 tempest-GroupSnapshotsTest-1518963210 None] Created reservations ['9b4bdc98-8085-4517-bcb9-adfd66057c72'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:36 devstack cinder-volume[87054]: WARNING cinder.quota [None req-1e7f9a32-aade-4626-8943-516249d39708 tempest-GroupSnapshotsTest-1518963210 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-854609395 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-854609395, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:41:36 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-1e7f9a32-aade-4626-8943-516249d39708 tempest-GroupSnapshotsTest-1518963210 None] Created reservations ['a828e825-36c9-4130-a648-9a18368a2f48', '714b2cb8-0c1e-4e72-84dc-2225dd3d768c', '00978902-d0ec-45c6-8ab1-901dfef0ab2d', 'ffe69764-3427-44ca-8065-43b672dd7cd2'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1e7f9a32-aade-4626-8943-516249d39708 tempest-GroupSnapshotsTest-1518963210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1e7f9a32-aade-4626-8943-516249d39708 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-1e7f9a32-aade-4626-8943-516249d39708 tempest-GroupSnapshotsTest-1518963210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-1e7f9a32-aade-4626-8943-516249d39708 tempest-GroupSnapshotsTest-1518963210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1e7f9a32-aade-4626-8943-516249d39708 tempest-GroupSnapshotsTest-1518963210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1e7f9a32-aade-4626-8943-516249d39708 tempest-GroupSnapshotsTest-1518963210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:37 devstack sudo[100979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:41:37 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:37 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1e7f9a32-aade-4626-8943-516249d39708 tempest-GroupSnapshotsTest-1518963210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.368s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:37 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-1e7f9a32-aade-4626-8943-516249d39708 tempest-GroupSnapshotsTest-1518963210 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:41:37 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-1e7f9a32-aade-4626-8943-516249d39708 tempest-GroupSnapshotsTest-1518963210 None] Delete group completed successfully.
Nov 07 02:41:46 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:41:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Flow 'volume_create_manager' (be6eac47-2fc7-4724-8a0e-9039046f88d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e87949c-76ea-4960-9789-35530fb7c00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e87949c-76ea-4960-9789-35530fb7c00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1693395172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321c9e40-12ea-4630-bd23-8cfa7d5ac049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b0dcfc2e33442eb75c4b4a9cd2dfc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:46Z,use_quota=True,user_id='f542c67d624d4235b358f08e2e5005ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f871743e-7a62-446b-b187-79daa5ee7db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f871743e-7a62-446b-b187-79daa5ee7db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70833318-0038-48a1-874b-bd38c1e54bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70833318-0038-48a1-874b-bd38c1e54bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '321c9e40-12ea-4630-bd23-8cfa7d5ac049', 'volume_name': 'volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c1f02d3-0335-4ab6-9cce-9566d883c94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c1f02d3-0335-4ab6-9cce-9566d883c94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2adc6f60-2be9-4825-86f1-fafedf265684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:46 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Volume 321c9e40-12ea-4630-bd23-8cfa7d5ac049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049', 'volume_size': 1}
Nov 07 02:41:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1693395172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321c9e40-12ea-4630-bd23-8cfa7d5ac049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b0dcfc2e33442eb75c4b4a9cd2dfc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:46Z,use_quota=True,user_id='f542c67d624d4235b358f08e2e5005ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:41:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Creating volume 321c9e40-12ea-4630-bd23-8cfa7d5ac049 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:41:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:41:46 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:41:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:46 devstack sudo[100988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049 1073741824
Nov 07 02:41:46 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:47 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049 1073741824" returned: 0 in 0.616s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:47 devstack sudo[100994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049
Nov 07 02:41:47 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:47 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049" returned: 0 in 0.383s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:41:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2adc6f60-2be9-4825-86f1-fafedf265684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bdde8c8-9236-416f-be5b-54d79c0df2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:47 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Volume volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049 (321c9e40-12ea-4630-bd23-8cfa7d5ac049): created successfully
Nov 07 02:41:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bdde8c8-9236-416f-be5b-54d79c0df2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Flow 'volume_create_manager' (be6eac47-2fc7-4724-8a0e-9039046f88d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:47 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-7e091c95-88d9-4ede-b0da-04f33386b9fe tempest-VolumesSnapshotTestJSON-1826004545 None] Created volume successfully.
Nov 07 02:41:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ee0dfbb2-800e-4df0-87d5-a4085bb3c096 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ee0dfbb2-800e-4df0-87d5-a4085bb3c096 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:49 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ee0dfbb2-800e-4df0-87d5-a4085bb3c096 tempest-VolumesSnapshotTestJSON-1826004545 None] Creating offline snapshot 986eaf62-35fb-49b9-a0f1-e2e95e918c45 of volume 321c9e40-12ea-4630-bd23-8cfa7d5ac049 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:41:49 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd2dbcb-399b-4852-b095-475fe13525c0]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ee0dfbb2-800e-4df0-87d5-a4085bb3c096 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:49 devstack sudo[100998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049
Nov 07 02:41:49 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:49 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ee0dfbb2-800e-4df0-87d5-a4085bb3c096 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049" returned: 0 in 0.467s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ee0dfbb2-800e-4df0-87d5-a4085bb3c096 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.986eaf62-35fb-49b9-a0f1-e2e95e918c45 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:49 devstack sudo[101003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.986eaf62-35fb-49b9-a0f1-e2e95e918c45 1G
Nov 07 02:41:49 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:50 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ee0dfbb2-800e-4df0-87d5-a4085bb3c096 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.986eaf62-35fb-49b9-a0f1-e2e95e918c45 1G" returned: 0 in 0.611s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ee0dfbb2-800e-4df0-87d5-a4085bb3c096 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.986eaf62-35fb-49b9-a0f1-e2e95e918c45 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:50 devstack sudo[101008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.986eaf62-35fb-49b9-a0f1-e2e95e918c45
Nov 07 02:41:50 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:50 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ee0dfbb2-800e-4df0-87d5-a4085bb3c096 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.986eaf62-35fb-49b9-a0f1-e2e95e918c45" returned: 0 in 0.354s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:50 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-ee0dfbb2-800e-4df0-87d5-a4085bb3c096 tempest-VolumesSnapshotTestJSON-1826004545 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.986eaf62-35fb-49b9-a0f1-e2e95e918c45 is being set with open permissions: ugo+rw
Nov 07 02:41:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ee0dfbb2-800e-4df0-87d5-a4085bb3c096 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.986eaf62-35fb-49b9-a0f1-e2e95e918c45 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:50 devstack sudo[101013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.986eaf62-35fb-49b9-a0f1-e2e95e918c45
Nov 07 02:41:50 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:50 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ee0dfbb2-800e-4df0-87d5-a4085bb3c096 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.986eaf62-35fb-49b9-a0f1-e2e95e918c45" returned: 0 in 0.373s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ee0dfbb2-800e-4df0-87d5-a4085bb3c096 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:51 devstack sudo[101016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.info
Nov 07 02:41:51 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:51 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ee0dfbb2-800e-4df0-87d5-a4085bb3c096 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.info" returned: 0 in 0.396s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:51 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-ee0dfbb2-800e-4df0-87d5-a4085bb3c096 tempest-VolumesSnapshotTestJSON-1826004545 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.info is being set with open permissions: ugo+rw
Nov 07 02:41:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ee0dfbb2-800e-4df0-87d5-a4085bb3c096 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:51 devstack sudo[101019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.info
Nov 07 02:41:51 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:51 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ee0dfbb2-800e-4df0-87d5-a4085bb3c096 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.info" returned: 0 in 0.301s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ee0dfbb2-800e-4df0-87d5-a4085bb3c096 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.661s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:51 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ee0dfbb2-800e-4df0-87d5-a4085bb3c096 tempest-VolumesSnapshotTestJSON-1826004545 None] Create snapshot completed successfully
Nov 07 02:41:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8895ea60-be9d-4061-a918-36e0432258fd tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "cinder-986eaf62-35fb-49b9-a0f1-e2e95e918c45-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8895ea60-be9d-4061-a918-36e0432258fd tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-986eaf62-35fb-49b9-a0f1-e2e95e918c45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8895ea60-be9d-4061-a918-36e0432258fd tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "cinder-quobyte-321c9e40-12ea-4630-bd23-8cfa7d5ac049" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8895ea60-be9d-4061-a918-36e0432258fd tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-321c9e40-12ea-4630-bd23-8cfa7d5ac049" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8895ea60-be9d-4061-a918-36e0432258fd tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "cinder-quobyte-986eaf62-35fb-49b9-a0f1-e2e95e918c45" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:41:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8895ea60-be9d-4061-a918-36e0432258fd tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-986eaf62-35fb-49b9-a0f1-e2e95e918c45" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:41:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-8895ea60-be9d-4061-a918-36e0432258fd tempest-VolumesSnapshotTestJSON-1826004545 None] Deleting offline snapshot 986eaf62-35fb-49b9-a0f1-e2e95e918c45 of volume 321c9e40-12ea-4630-bd23-8cfa7d5ac049 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:41:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-8895ea60-be9d-4061-a918-36e0432258fd tempest-VolumesSnapshotTestJSON-1826004545 None] snapshot_file for this snap is: volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.986eaf62-35fb-49b9-a0f1-e2e95e918c45 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:41:52 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[7691b7f2-79a1-47d6-8cee-ba32ed3fb934]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8895ea60-be9d-4061-a918-36e0432258fd tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.986eaf62-35fb-49b9-a0f1-e2e95e918c45 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:52 devstack sudo[101022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.986eaf62-35fb-49b9-a0f1-e2e95e918c45
Nov 07 02:41:52 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:53 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8895ea60-be9d-4061-a918-36e0432258fd tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.986eaf62-35fb-49b9-a0f1-e2e95e918c45" returned: 0 in 0.457s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-8895ea60-be9d-4061-a918-36e0432258fd tempest-VolumesSnapshotTestJSON-1826004545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:41:53 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d82ce5-61e1-4c55-a9b8-f5293cfa271a]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8895ea60-be9d-4061-a918-36e0432258fd tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:53 devstack sudo[101027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049
Nov 07 02:41:53 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:53 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8895ea60-be9d-4061-a918-36e0432258fd tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049" returned: 0 in 0.482s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8895ea60-be9d-4061-a918-36e0432258fd tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.986eaf62-35fb-49b9-a0f1-e2e95e918c45 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:53 devstack sudo[101032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.986eaf62-35fb-49b9-a0f1-e2e95e918c45
Nov 07 02:41:53 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:54 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8895ea60-be9d-4061-a918-36e0432258fd tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.986eaf62-35fb-49b9-a0f1-e2e95e918c45" returned: 0 in 0.439s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8895ea60-be9d-4061-a918-36e0432258fd tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.986eaf62-35fb-49b9-a0f1-e2e95e918c45 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:54 devstack sudo[101038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.986eaf62-35fb-49b9-a0f1-e2e95e918c45
Nov 07 02:41:54 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:54 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8895ea60-be9d-4061-a918-36e0432258fd tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049.986eaf62-35fb-49b9-a0f1-e2e95e918c45" returned: 0 in 0.303s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8895ea60-be9d-4061-a918-36e0432258fd tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-986eaf62-35fb-49b9-a0f1-e2e95e918c45" released by "_delete_snapshot" :: held 1.859s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8895ea60-be9d-4061-a918-36e0432258fd tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-321c9e40-12ea-4630-bd23-8cfa7d5ac049" released by "delete_snapshot" :: held 1.892s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-8895ea60-be9d-4061-a918-36e0432258fd tempest-VolumesSnapshotTestJSON-1826004545 None] Created reservations ['93be7f75-7807-4ab3-9a99-eeb3afc30a62', '1c1c2ab3-900e-4ee3-b7fd-dd5b546d1f48', 'a6f58041-0c0f-425b-baed-bc8af3dfe9f4', 'e3124ec1-2e79-40ee-9162-277e66ea7821'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:41:54 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-8895ea60-be9d-4061-a918-36e0432258fd tempest-VolumesSnapshotTestJSON-1826004545 None] Delete snapshot completed successfully.
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8895ea60-be9d-4061-a918-36e0432258fd tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-986eaf62-35fb-49b9-a0f1-e2e95e918c45-delete_snapshot" released by "delete_snapshot" :: held 2.139s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Flow 'volume_create_manager' (4f1dadc3-4235-4bfd-8bcd-b482948ddb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (936ddc72-e7a6-401b-95c4-dd878a0c8368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (936ddc72-e7a6-401b-95c4-dd878a0c8368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1679560723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7845ed1f-f202-42cc-88cd-0d4e002b3bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fca763993b5e471d8bf3e700cb527069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:55Z,use_quota=True,user_id='8fa1556a055e4e279baf72eda5e1e62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcdad37d-57b3-4211-aec1-8d31fce45a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcdad37d-57b3-4211-aec1-8d31fce45a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f235506c-770b-494f-99f9-a55e92b95931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f235506c-770b-494f-99f9-a55e92b95931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7845ed1f-f202-42cc-88cd-0d4e002b3bd3', 'volume_name': 'volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088f56a5-ad29-4750-b61a-4ad9fd2517ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088f56a5-ad29-4750-b61a-4ad9fd2517ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5b84a4-1e9e-4ddd-a247-78fcde47075b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:54 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Volume 7845ed1f-f202-42cc-88cd-0d4e002b3bd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3', 'volume_size': 1}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1679560723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7845ed1f-f202-42cc-88cd-0d4e002b3bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fca763993b5e471d8bf3e700cb527069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:55Z,use_quota=True,user_id='8fa1556a055e4e279baf72eda5e1e62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Creating volume 7845ed1f-f202-42cc-88cd-0d4e002b3bd3 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:41:54 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:41:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:54 devstack sudo[101041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3 1073741824
Nov 07 02:41:54 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Flow 'volume_create_manager' (4c9b06c8-02bf-4d76-82ae-ab0eddc7fadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d5a2b0-357d-46a9-bc77-9369d6740336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d5a2b0-357d-46a9-bc77-9369d6740336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-946231322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6de84f2-94af-45a9-95b7-2d2c06890d12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b0dcfc2e33442eb75c4b4a9cd2dfc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:55Z,use_quota=True,user_id='f542c67d624d4235b358f08e2e5005ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e11ea0-c44b-443b-9f9d-89af0812b848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e11ea0-c44b-443b-9f9d-89af0812b848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd81ab8c-8933-4fd8-b309-99220bffd7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd81ab8c-8933-4fd8-b309-99220bffd7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6de84f2-94af-45a9-95b7-2d2c06890d12', 'volume_name': 'volume-e6de84f2-94af-45a9-95b7-2d2c06890d12', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0fbb0b-f4dd-45f5-a216-a87fbcaa507f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0fbb0b-f4dd-45f5-a216-a87fbcaa507f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b182c72-dd52-4eab-927a-d46cc4d1d87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:55 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Volume e6de84f2-94af-45a9-95b7-2d2c06890d12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6de84f2-94af-45a9-95b7-2d2c06890d12', 'volume_size': 1}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:55 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3 1073741824" returned: 0 in 0.598s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:55 devstack sudo[101047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3
Nov 07 02:41:55 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:55 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3" returned: 0 in 0.259s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.329s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-946231322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6de84f2-94af-45a9-95b7-2d2c06890d12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b0dcfc2e33442eb75c4b4a9cd2dfc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:55Z,use_quota=True,user_id='f542c67d624d4235b358f08e2e5005ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Creating volume e6de84f2-94af-45a9-95b7-2d2c06890d12 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:41:55 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5b84a4-1e9e-4ddd-a247-78fcde47075b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:55 devstack sudo[101050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12 1073741824
Nov 07 02:41:55 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ecf256f-2292-48be-8f7d-c3d945a33271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:55 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Volume volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3 (7845ed1f-f202-42cc-88cd-0d4e002b3bd3): created successfully
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ecf256f-2292-48be-8f7d-c3d945a33271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Flow 'volume_create_manager' (4f1dadc3-4235-4bfd-8bcd-b482948ddb47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:55 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-9863a965-d015-422e-b335-de17fea8131b tempest-TestImageHashVerification-1973740161 None] Created volume successfully.
Nov 07 02:41:56 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12 1073741824" returned: 0 in 0.500s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:56 devstack sudo[101056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12
Nov 07 02:41:56 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:56 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12" returned: 0 in 0.256s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:56 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:41:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:56 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b182c72-dd52-4eab-927a-d46cc4d1d87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6de84f2-94af-45a9-95b7-2d2c06890d12', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:56 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ba84fc2-0549-4877-a457-42355dd3d5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:56 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Volume volume-e6de84f2-94af-45a9-95b7-2d2c06890d12 (e6de84f2-94af-45a9-95b7-2d2c06890d12): created successfully
Nov 07 02:41:56 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ba84fc2-0549-4877-a457-42355dd3d5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:56 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Flow 'volume_create_manager' (4c9b06c8-02bf-4d76-82ae-ab0eddc7fadc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:56 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-bd17c0a8-4155-471d-aa75-158dbcf0e926 tempest-VolumesSnapshotTestJSON-1826004545 None] Created volume successfully.
Nov 07 02:41:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-639ff165-0541-447b-a7b8-b462d4fc0932 tempest-TestImageHashVerification-1973740161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-639ff165-0541-447b-a7b8-b462d4fc0932 tempest-TestImageHashVerification-1973740161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:57 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a225ac3-f2b6-4a22-bf2b-fdc52153e8c7]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-639ff165-0541-447b-a7b8-b462d4fc0932 tempest-TestImageHashVerification-1973740161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:57 devstack sudo[101059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3
Nov 07 02:41:57 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d26dc9ae-79b0-47cc-9294-9978050873c5 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:58 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-639ff165-0541-447b-a7b8-b462d4fc0932 tempest-TestImageHashVerification-1973740161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3" returned: 0 in 0.425s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:58 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb30db2b-7ef2-4aa0-b6b7-b6077bd8fc52]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:41:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-639ff165-0541-447b-a7b8-b462d4fc0932 tempest-TestImageHashVerification-1973740161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:58 devstack sudo[101066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3
Nov 07 02:41:58 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:58 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:41:58 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Flow 'volume_create_manager' (855613a4-32aa-40b0-91a8-77d4976d7d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:41:58 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6d13da-82b2-45c3-831b-dbebcfaf66d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:58 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6d13da-82b2-45c3-831b-dbebcfaf66d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-368992704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802920cf-74b2-454f-9c77-19bb9b039f87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7177cb04f814a8a834e6a79dd096f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:58Z,use_quota=True,user_id='712a010454a24e6fb41e14a23cb83989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:58 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfdb3f11-2031-49d7-b444-88dd8476aa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:58 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfdb3f11-2031-49d7-b444-88dd8476aa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:58 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba9e1e70-c04d-4afb-961b-70226b951a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:58 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba9e1e70-c04d-4afb-961b-70226b951a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '802920cf-74b2-454f-9c77-19bb9b039f87', 'volume_name': 'volume-802920cf-74b2-454f-9c77-19bb9b039f87', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:58 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e6e920-b013-4065-8a56-4d4079ae9570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:58 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e6e920-b013-4065-8a56-4d4079ae9570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:41:58 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0060002-169e-406c-8023-13ad3c9846aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:41:58 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Volume 802920cf-74b2-454f-9c77-19bb9b039f87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-802920cf-74b2-454f-9c77-19bb9b039f87', 'volume_size': 1}
Nov 07 02:41:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:58 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-639ff165-0541-447b-a7b8-b462d4fc0932 tempest-TestImageHashVerification-1973740161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3" returned: 0 in 0.373s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-639ff165-0541-447b-a7b8-b462d4fc0932 tempest-TestImageHashVerification-1973740161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3 /opt/stack/data/cinder/conversion/7845ed1f-f202-42cc-88cd-0d4e002b3bd3.temp_image.55e31dcc-1d8c-48ef-b346-125953a79e37ndk0p9xo.img {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:58 devstack sudo[101071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3 /opt/stack/data/cinder/conversion/7845ed1f-f202-42cc-88cd-0d4e002b3bd3.temp_image.55e31dcc-1d8c-48ef-b346-125953a79e37ndk0p9xo.img
Nov 07 02:41:58 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:41:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:41:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:41:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:41:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:41:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:41:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:41:59 devstack sudo[101083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:41:59 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:41:59 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root
Nov 07 02:41:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.335s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:41:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:41:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:41:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 28 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:41:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>, <Thread(fd_logger, started daemon 125443282798592)>, <Thread(privsep_reader, started daemon 125443284556288)>, <Thread(tpool_thread_0, started daemon 125443276445376)>, <Thread(tpool_thread_1, started daemon 125443268036288)>, <Thread(tpool_thread_2, started daemon 125443259627200)>, <Thread(tpool_thread_3, started daemon 125443251218112)>, <Thread(tpool_thread_4, started daemon 125443242809024)>, <Thread(tpool_thread_5, started daemon 125443234399936)>, <Thread(tpool_thread_6, started daemon 125443225990848)>, <Thread(tpool_thread_7, started daemon 125443217581760)>, <Thread(tpool_thread_8, started daemon 125443209172672)>, <Thread(tpool_thread_9, started daemon 125443200763584)>, <Thread(tpool_thread_10, started daemon 125443192354496)>, <Thread(tpool_thread_11, started daemon 125443183945408)>, <Thread(tpool_thread_12, started daemon 125443175536320)>, <Thread(tpool_thread_13, started daemon 125443167127232)>, <Thread(tpool_thread_14, started daemon 125443158718144)>, <Thread(tpool_thread_15, started daemon 125443150309056)>, <Thread(tpool_thread_16, started daemon 125443141899968)>, <Thread(tpool_thread_17, started daemon 125443133490880)>, <Thread(tpool_thread_18, started daemon 125443125081792)>, <Thread(tpool_thread_19, started daemon 125443116672704)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:42:04 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-639ff165-0541-447b-a7b8-b462d4fc0932 tempest-TestImageHashVerification-1973740161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3 /opt/stack/data/cinder/conversion/7845ed1f-f202-42cc-88cd-0d4e002b3bd3.temp_image.55e31dcc-1d8c-48ef-b346-125953a79e37ndk0p9xo.img" returned: 0 in 6.133s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:04 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[493cd861-1743-4519-b677-ea2f631cb165]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-639ff165-0541-447b-a7b8-b462d4fc0932 tempest-TestImageHashVerification-1973740161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:04 devstack sudo[101124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3
Nov 07 02:42:04 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:05 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-639ff165-0541-447b-a7b8-b462d4fc0932 tempest-TestImageHashVerification-1973740161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3" returned: 0 in 0.515s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:05 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-639ff165-0541-447b-a7b8-b462d4fc0932 tempest-TestImageHashVerification-1973740161 None] Image conversion details: src /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3, size 1024.00 MB, duration 6.13 sec, destination /opt/stack/data/cinder/conversion/7845ed1f-f202-42cc-88cd-0d4e002b3bd3.temp_image.55e31dcc-1d8c-48ef-b346-125953a79e37ndk0p9xo.img {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:42:05 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-639ff165-0541-447b-a7b8-b462d4fc0932 tempest-TestImageHashVerification-1973740161 None] Converted 1024.00 MB image at 166.93 MB/s
Nov 07 02:42:05 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=124,cinder:UPDATE=140,cinder:INSERT=41,cinder:DELETE=13 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:42:05 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:UPDATE=151,cinder:SELECT=139,cinder:INSERT=27,cinder:DELETE=4 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:42:05 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-639ff165-0541-447b-a7b8-b462d4fc0932 tempest-TestImageHashVerification-1973740161 None] 55e31dcc-1d8c-48ef-b346-125953a79e37 was raw, no need to convert to raw {{(pid=87054) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 07 02:42:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-639ff165-0541-447b-a7b8-b462d4fc0932 tempest-TestImageHashVerification-1973740161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.509s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-639ff165-0541-447b-a7b8-b462d4fc0932 tempest-TestImageHashVerification-1973740161 None] Uploaded volume to glance image-id: 55e31dcc-1d8c-48ef-b346-125953a79e37. {{(pid=87054) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 07 02:42:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d26dc9ae-79b0-47cc-9294-9978050873c5 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 25.281s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-d26dc9ae-79b0-47cc-9294-9978050873c5 tempest-VolumesSnapshotTestJSON-1826004545 None] Creating offline snapshot d8c2c179-7ba0-4af8-9611-911a29d77e2d of volume e6de84f2-94af-45a9-95b7-2d2c06890d12 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:42:23 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-639ff165-0541-447b-a7b8-b462d4fc0932 tempest-TestImageHashVerification-1973740161 None] Copy volume to image completed successfully.
Nov 07 02:42:23 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae4b029-de54-4bb4-afe4-7a06bd81058b]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d26dc9ae-79b0-47cc-9294-9978050873c5 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:23 devstack sudo[101137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12
Nov 07 02:42:23 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:23 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d26dc9ae-79b0-47cc-9294-9978050873c5 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12" returned: 0 in 0.346s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d26dc9ae-79b0-47cc-9294-9978050873c5 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.d8c2c179-7ba0-4af8-9611-911a29d77e2d 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:23 devstack sudo[101142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.d8c2c179-7ba0-4af8-9611-911a29d77e2d 1G
Nov 07 02:42:23 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:23 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d26dc9ae-79b0-47cc-9294-9978050873c5 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.d8c2c179-7ba0-4af8-9611-911a29d77e2d 1G" returned: 0 in 0.455s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d26dc9ae-79b0-47cc-9294-9978050873c5 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6de84f2-94af-45a9-95b7-2d2c06890d12 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.d8c2c179-7ba0-4af8-9611-911a29d77e2d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:24 devstack sudo[101147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6de84f2-94af-45a9-95b7-2d2c06890d12 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.d8c2c179-7ba0-4af8-9611-911a29d77e2d
Nov 07 02:42:24 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-44c3bdb1-4798-4b0d-ab1b-f6836d2dce9f tempest-TestImageHashVerification-1973740161 None] Acquiring lock "cinder-7845ed1f-f202-42cc-88cd-0d4e002b3bd3-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-44c3bdb1-4798-4b0d-ab1b-f6836d2dce9f tempest-TestImageHashVerification-1973740161 None] Lock "cinder-7845ed1f-f202-42cc-88cd-0d4e002b3bd3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-44c3bdb1-4798-4b0d-ab1b-f6836d2dce9f tempest-TestImageHashVerification-1973740161 None] Acquiring lock "cinder-quobyte-7845ed1f-f202-42cc-88cd-0d4e002b3bd3" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-44c3bdb1-4798-4b0d-ab1b-f6836d2dce9f tempest-TestImageHashVerification-1973740161 None] Lock "cinder-quobyte-7845ed1f-f202-42cc-88cd-0d4e002b3bd3" acquired by "delete_volume" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:24 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[975370ed-d034-462f-9027-cecb59109411]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-44c3bdb1-4798-4b0d-ab1b-f6836d2dce9f tempest-TestImageHashVerification-1973740161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:24 devstack sudo[101149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3
Nov 07 02:42:24 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:24 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d26dc9ae-79b0-47cc-9294-9978050873c5 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6de84f2-94af-45a9-95b7-2d2c06890d12 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.d8c2c179-7ba0-4af8-9611-911a29d77e2d" returned: 0 in 0.319s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:24 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-d26dc9ae-79b0-47cc-9294-9978050873c5 tempest-VolumesSnapshotTestJSON-1826004545 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.d8c2c179-7ba0-4af8-9611-911a29d77e2d is being set with open permissions: ugo+rw
Nov 07 02:42:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d26dc9ae-79b0-47cc-9294-9978050873c5 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.d8c2c179-7ba0-4af8-9611-911a29d77e2d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:24 devstack sudo[101154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.d8c2c179-7ba0-4af8-9611-911a29d77e2d
Nov 07 02:42:24 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:24 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-44c3bdb1-4798-4b0d-ab1b-f6836d2dce9f tempest-TestImageHashVerification-1973740161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3" returned: 0 in 0.386s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-44c3bdb1-4798-4b0d-ab1b-f6836d2dce9f tempest-TestImageHashVerification-1973740161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:24 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d26dc9ae-79b0-47cc-9294-9978050873c5 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.d8c2c179-7ba0-4af8-9611-911a29d77e2d" returned: 0 in 0.248s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:24 devstack sudo[101160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3
Nov 07 02:42:24 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d26dc9ae-79b0-47cc-9294-9978050873c5 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:24 devstack sudo[101162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.info
Nov 07 02:42:24 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:24 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-44c3bdb1-4798-4b0d-ab1b-f6836d2dce9f tempest-TestImageHashVerification-1973740161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7845ed1f-f202-42cc-88cd-0d4e002b3bd3" returned: 0 in 0.240s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-44c3bdb1-4798-4b0d-ab1b-f6836d2dce9f tempest-TestImageHashVerification-1973740161 None] Lock "cinder-quobyte-7845ed1f-f202-42cc-88cd-0d4e002b3bd3" released by "delete_volume" :: held 0.668s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:24 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-44c3bdb1-4798-4b0d-ab1b-f6836d2dce9f tempest-TestImageHashVerification-1973740161 None] Created reservations ['f1a4aefa-47eb-47d5-83ac-fa0063dcc69a', '6e56ac4b-c945-4b39-9f83-325546d93b8b', '9cd99f22-6197-4a2b-901c-a55d65b296a1', '72b05af4-2d22-4afc-ad45-66f40d8c5b37'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:42:24 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d26dc9ae-79b0-47cc-9294-9978050873c5 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.info" returned: 0 in 0.288s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:24 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-d26dc9ae-79b0-47cc-9294-9978050873c5 tempest-VolumesSnapshotTestJSON-1826004545 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.info is being set with open permissions: ugo+rw
Nov 07 02:42:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d26dc9ae-79b0-47cc-9294-9978050873c5 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:24 devstack sudo[101166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.info
Nov 07 02:42:24 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-44c3bdb1-4798-4b0d-ab1b-f6836d2dce9f tempest-TestImageHashVerification-1973740161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-44c3bdb1-4798-4b0d-ab1b-f6836d2dce9f tempest-TestImageHashVerification-1973740161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-44c3bdb1-4798-4b0d-ab1b-f6836d2dce9f tempest-TestImageHashVerification-1973740161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-44c3bdb1-4798-4b0d-ab1b-f6836d2dce9f tempest-TestImageHashVerification-1973740161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-44c3bdb1-4798-4b0d-ab1b-f6836d2dce9f tempest-TestImageHashVerification-1973740161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-44c3bdb1-4798-4b0d-ab1b-f6836d2dce9f tempest-TestImageHashVerification-1973740161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:25 devstack sudo[101168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:42:25 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:25 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d26dc9ae-79b0-47cc-9294-9978050873c5 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.info" returned: 0 in 0.263s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d26dc9ae-79b0-47cc-9294-9978050873c5 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.029s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.776s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-368992704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802920cf-74b2-454f-9c77-19bb9b039f87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7177cb04f814a8a834e6a79dd096f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:41:58Z,use_quota=True,user_id='712a010454a24e6fb41e14a23cb83989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:42:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Creating volume 802920cf-74b2-454f-9c77-19bb9b039f87 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:42:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:42:25 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:42:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:25 devstack sudo[101172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87 1073741824
Nov 07 02:42:25 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:25 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-d26dc9ae-79b0-47cc-9294-9978050873c5 tempest-VolumesSnapshotTestJSON-1826004545 None] Create snapshot completed successfully
Nov 07 02:42:25 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-44c3bdb1-4798-4b0d-ab1b-f6836d2dce9f tempest-TestImageHashVerification-1973740161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.295s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:25 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-44c3bdb1-4798-4b0d-ab1b-f6836d2dce9f tempest-TestImageHashVerification-1973740161 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:42:25 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-44c3bdb1-4798-4b0d-ab1b-f6836d2dce9f tempest-TestImageHashVerification-1973740161 None] Deleted volume successfully.
Nov 07 02:42:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-44c3bdb1-4798-4b0d-ab1b-f6836d2dce9f tempest-TestImageHashVerification-1973740161 None] Lock "cinder-7845ed1f-f202-42cc-88cd-0d4e002b3bd3-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:25 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87 1073741824" returned: 0 in 0.452s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:25 devstack sudo[101178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87
Nov 07 02:42:25 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:25 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87" returned: 0 in 0.308s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0060002-169e-406c-8023-13ad3c9846aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-802920cf-74b2-454f-9c77-19bb9b039f87', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b61f08-8802-4d9a-a480-6f390677117c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:26 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Volume volume-802920cf-74b2-454f-9c77-19bb9b039f87 (802920cf-74b2-454f-9c77-19bb9b039f87): created successfully
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b61f08-8802-4d9a-a480-6f390677117c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Flow 'volume_create_manager' (855613a4-32aa-40b0-91a8-77d4976d7d2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:26 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f515a037-b10f-4d20-a0fe-cb013da4ea7d tempest-SnapshotsActionsTest-2075701007 None] Created volume successfully.
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Flow 'volume_create_manager' (a3d1d542-2a70-441d-8489-a4745f9eec13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b80e9e-c19a-4b3e-a9f3-783af0a999cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b80e9e-c19a-4b3e-a9f3-783af0a999cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1881393642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c1fadc-9b99-4bbb-b87c-73401ae2738e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b0dcfc2e33442eb75c4b4a9cd2dfc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:42:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=d8c2c179-7ba0-4af8-9611-911a29d77e2d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:42:27Z,use_quota=True,user_id='f542c67d624d4235b358f08e2e5005ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61392586-90d5-46db-80de-4cbf5d49509a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61392586-90d5-46db-80de-4cbf5d49509a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24b527a-86e3-4a6f-acd1-34ace858e3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24b527a-86e3-4a6f-acd1-34ace858e3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '33c1fadc-9b99-4bbb-b87c-73401ae2738e', 'volume_name': 'volume-33c1fadc-9b99-4bbb-b87c-73401ae2738e', 'volume_size': 2, 'snapshot_id': 'd8c2c179-7ba0-4af8-9611-911a29d77e2d'}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07103540-6e8f-4675-9bd7-9b7a6e8904f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07103540-6e8f-4675-9bd7-9b7a6e8904f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e989e971-8d0c-4b2b-9ea1-c3624dff48e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:26 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Volume 33c1fadc-9b99-4bbb-b87c-73401ae2738e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-33c1fadc-9b99-4bbb-b87c-73401ae2738e', 'volume_size': 2, 'snapshot_id': 'd8c2c179-7ba0-4af8-9611-911a29d77e2d'}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "cinder-quobyte-d8c2c179-7ba0-4af8-9611-911a29d77e2d-33c1fadc-9b99-4bbb-b87c-73401ae2738e" by "_create_volume_from_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-d8c2c179-7ba0-4af8-9611-911a29d77e2d-33c1fadc-9b99-4bbb-b87c-73401ae2738e" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Creating volume 33c1fadc-9b99-4bbb-b87c-73401ae2738e from snapshot d8c2c179-7ba0-4af8-9611-911a29d77e2d {{(pid=87054) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "cinder-quobyte-33c1fadc-9b99-4bbb-b87c-73401ae2738e" by "_copy_volume_from_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-33c1fadc-9b99-4bbb-b87c-73401ae2738e" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] snapshot: d8c2c179-7ba0-4af8-9611-911a29d77e2d, volume: 33c1fadc-9b99-4bbb-b87c-73401ae2738e,  {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efb301a-b6a2-4036-b772-f540b057d354]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.d8c2c179-7ba0-4af8-9611-911a29d77e2d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:26 devstack sudo[101183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.d8c2c179-7ba0-4af8-9611-911a29d77e2d
Nov 07 02:42:26 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:27 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.d8c2c179-7ba0-4af8-9611-911a29d77e2d" returned: 0 in 0.386s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6de84f2-94af-45a9-95b7-2d2c06890d12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:42:27 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a50d30-66c0-4b6d-918c-5113034bae3a]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:27 devstack sudo[101188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12
Nov 07 02:42:27 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b8cdc2dc-f56f-41cf-b10c-8d6bc1d41584 tempest-SnapshotsActionsTest-2075701007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:27 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12" returned: 0 in 0.395s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12 {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:42:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Creating direct copy from snapshot {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:42:27 devstack cinder-volume[87054]: DEBUG cinder.utils [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Path /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-33c1fadc-9b99-4bbb-b87c-73401ae2738e not found in is_blk_device check {{(pid=87054) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:42:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-33c1fadc-9b99-4bbb-b87c-73401ae2738e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:27 devstack sudo[101193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-33c1fadc-9b99-4bbb-b87c-73401ae2738e
Nov 07 02:42:27 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:34 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-33c1fadc-9b99-4bbb-b87c-73401ae2738e" returned: 0 in 6.978s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:34 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Image conversion details: src /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12, size 1024.00 MB, duration 6.98 sec, destination /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-33c1fadc-9b99-4bbb-b87c-73401ae2738e {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:42:34 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Converted 1024.00 MB image at 146.72 MB/s
Nov 07 02:42:34 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-33c1fadc-9b99-4bbb-b87c-73401ae2738e is being set with open permissions: ugo+rw
Nov 07 02:42:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-33c1fadc-9b99-4bbb-b87c-73401ae2738e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:34 devstack sudo[101209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-33c1fadc-9b99-4bbb-b87c-73401ae2738e
Nov 07 02:42:34 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:34 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-33c1fadc-9b99-4bbb-b87c-73401ae2738e" returned: 0 in 0.236s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-33c1fadc-9b99-4bbb-b87c-73401ae2738e" released by "_copy_volume_from_snapshot" :: held 8.089s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-d8c2c179-7ba0-4af8-9611-911a29d77e2d-33c1fadc-9b99-4bbb-b87c-73401ae2738e" released by "_create_volume_from_snapshot" :: held 8.170s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.189s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b8cdc2dc-f56f-41cf-b10c-8d6bc1d41584 tempest-SnapshotsActionsTest-2075701007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.504s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-b8cdc2dc-f56f-41cf-b10c-8d6bc1d41584 tempest-SnapshotsActionsTest-2075701007 None] Creating offline snapshot 175c3bdd-eeae-4e39-9d34-bd10c2fec932 of volume 802920cf-74b2-454f-9c77-19bb9b039f87 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:42:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e989e971-8d0c-4b2b-9ea1-c3624dff48e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33c1fadc-9b99-4bbb-b87c-73401ae2738e', 'volume_size': 2, 'snapshot_id': 'd8c2c179-7ba0-4af8-9611-911a29d77e2d'}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a72f63f-cc9e-4fbb-bd40-c9e8350d6353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:34 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[b770c7e7-f5eb-4352-aa45-0c31de6f4ff8]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b8cdc2dc-f56f-41cf-b10c-8d6bc1d41584 tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:34 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Volume volume-33c1fadc-9b99-4bbb-b87c-73401ae2738e (33c1fadc-9b99-4bbb-b87c-73401ae2738e): created successfully
Nov 07 02:42:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a72f63f-cc9e-4fbb-bd40-c9e8350d6353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Flow 'volume_create_manager' (a3d1d542-2a70-441d-8489-a4745f9eec13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:35 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-00af3133-0bfc-42af-bd27-df5684af71ad tempest-VolumesSnapshotTestJSON-1826004545 None] Created volume successfully.
Nov 07 02:42:35 devstack sudo[101212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87
Nov 07 02:42:35 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:35 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b8cdc2dc-f56f-41cf-b10c-8d6bc1d41584 tempest-SnapshotsActionsTest-2075701007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87" returned: 0 in 0.371s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b8cdc2dc-f56f-41cf-b10c-8d6bc1d41584 tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e95f5ad8-17b1-470e-8909-da95ac92bff3 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "cinder-33c1fadc-9b99-4bbb-b87c-73401ae2738e-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:35 devstack sudo[101218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 1G
Nov 07 02:42:35 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e95f5ad8-17b1-470e-8909-da95ac92bff3 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-33c1fadc-9b99-4bbb-b87c-73401ae2738e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e95f5ad8-17b1-470e-8909-da95ac92bff3 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "cinder-quobyte-33c1fadc-9b99-4bbb-b87c-73401ae2738e" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e95f5ad8-17b1-470e-8909-da95ac92bff3 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-33c1fadc-9b99-4bbb-b87c-73401ae2738e" acquired by "delete_volume" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:35 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdf21bc-7dc3-443f-a580-7d377d51ec12]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e95f5ad8-17b1-470e-8909-da95ac92bff3 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-33c1fadc-9b99-4bbb-b87c-73401ae2738e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:35 devstack sudo[101220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-33c1fadc-9b99-4bbb-b87c-73401ae2738e
Nov 07 02:42:35 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:35 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e95f5ad8-17b1-470e-8909-da95ac92bff3 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-33c1fadc-9b99-4bbb-b87c-73401ae2738e" returned: 0 in 0.412s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e95f5ad8-17b1-470e-8909-da95ac92bff3 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-33c1fadc-9b99-4bbb-b87c-73401ae2738e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:35 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b8cdc2dc-f56f-41cf-b10c-8d6bc1d41584 tempest-SnapshotsActionsTest-2075701007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 1G" returned: 0 in 0.557s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b8cdc2dc-f56f-41cf-b10c-8d6bc1d41584 tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802920cf-74b2-454f-9c77-19bb9b039f87 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:35 devstack sudo[101229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-33c1fadc-9b99-4bbb-b87c-73401ae2738e
Nov 07 02:42:35 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:35 devstack sudo[101230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802920cf-74b2-454f-9c77-19bb9b039f87 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932
Nov 07 02:42:35 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:36 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e95f5ad8-17b1-470e-8909-da95ac92bff3 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-33c1fadc-9b99-4bbb-b87c-73401ae2738e" returned: 0 in 0.274s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e95f5ad8-17b1-470e-8909-da95ac92bff3 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-33c1fadc-9b99-4bbb-b87c-73401ae2738e" released by "delete_volume" :: held 0.730s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:36 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b8cdc2dc-f56f-41cf-b10c-8d6bc1d41584 tempest-SnapshotsActionsTest-2075701007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802920cf-74b2-454f-9c77-19bb9b039f87 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932" returned: 0 in 0.306s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:36 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-b8cdc2dc-f56f-41cf-b10c-8d6bc1d41584 tempest-SnapshotsActionsTest-2075701007 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 is being set with open permissions: ugo+rw
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b8cdc2dc-f56f-41cf-b10c-8d6bc1d41584 tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:36 devstack sudo[101237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932
Nov 07 02:42:36 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-e95f5ad8-17b1-470e-8909-da95ac92bff3 tempest-VolumesSnapshotTestJSON-1826004545 None] Created reservations ['74e6535a-6f13-42da-becd-27cb6b6c4fb6', '76a4005f-2e34-498e-b4af-7d05584557de', 'c9ffa7f1-0662-44d6-9a1e-dbfb38574026', 'b96d0020-6d71-41a5-9783-ce0311e0d575'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e95f5ad8-17b1-470e-8909-da95ac92bff3 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e95f5ad8-17b1-470e-8909-da95ac92bff3 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e95f5ad8-17b1-470e-8909-da95ac92bff3 tempest-VolumesSnapshotTestJSON-1826004545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e95f5ad8-17b1-470e-8909-da95ac92bff3 tempest-VolumesSnapshotTestJSON-1826004545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e95f5ad8-17b1-470e-8909-da95ac92bff3 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e95f5ad8-17b1-470e-8909-da95ac92bff3 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:36 devstack sudo[101239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:42:36 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:36 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b8cdc2dc-f56f-41cf-b10c-8d6bc1d41584 tempest-SnapshotsActionsTest-2075701007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932" returned: 0 in 0.274s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b8cdc2dc-f56f-41cf-b10c-8d6bc1d41584 tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:36 devstack sudo[101242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.info
Nov 07 02:42:36 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-363da6a5-f6ab-4096-bcfa-1664c69d6ea6 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "cinder-d8c2c179-7ba0-4af8-9611-911a29d77e2d-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-363da6a5-f6ab-4096-bcfa-1664c69d6ea6 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-d8c2c179-7ba0-4af8-9611-911a29d77e2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-363da6a5-f6ab-4096-bcfa-1664c69d6ea6 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "cinder-quobyte-e6de84f2-94af-45a9-95b7-2d2c06890d12" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-363da6a5-f6ab-4096-bcfa-1664c69d6ea6 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-e6de84f2-94af-45a9-95b7-2d2c06890d12" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-363da6a5-f6ab-4096-bcfa-1664c69d6ea6 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "cinder-quobyte-d8c2c179-7ba0-4af8-9611-911a29d77e2d" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:36 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e95f5ad8-17b1-470e-8909-da95ac92bff3 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.360s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-e95f5ad8-17b1-470e-8909-da95ac92bff3 tempest-VolumesSnapshotTestJSON-1826004545 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-363da6a5-f6ab-4096-bcfa-1664c69d6ea6 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-d8c2c179-7ba0-4af8-9611-911a29d77e2d" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-363da6a5-f6ab-4096-bcfa-1664c69d6ea6 tempest-VolumesSnapshotTestJSON-1826004545 None] Deleting offline snapshot d8c2c179-7ba0-4af8-9611-911a29d77e2d of volume e6de84f2-94af-45a9-95b7-2d2c06890d12 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-363da6a5-f6ab-4096-bcfa-1664c69d6ea6 tempest-VolumesSnapshotTestJSON-1826004545 None] snapshot_file for this snap is: volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.d8c2c179-7ba0-4af8-9611-911a29d77e2d {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:42:36 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-e95f5ad8-17b1-470e-8909-da95ac92bff3 tempest-VolumesSnapshotTestJSON-1826004545 None] Deleted volume successfully.
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[549307c9-2de1-4b29-94f2-0e835d219b28]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-363da6a5-f6ab-4096-bcfa-1664c69d6ea6 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.d8c2c179-7ba0-4af8-9611-911a29d77e2d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e95f5ad8-17b1-470e-8909-da95ac92bff3 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-33c1fadc-9b99-4bbb-b87c-73401ae2738e-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:36 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b8cdc2dc-f56f-41cf-b10c-8d6bc1d41584 tempest-SnapshotsActionsTest-2075701007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.info" returned: 0 in 0.376s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:36 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-b8cdc2dc-f56f-41cf-b10c-8d6bc1d41584 tempest-SnapshotsActionsTest-2075701007 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.info is being set with open permissions: ugo+rw
Nov 07 02:42:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b8cdc2dc-f56f-41cf-b10c-8d6bc1d41584 tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:36 devstack sudo[101246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.d8c2c179-7ba0-4af8-9611-911a29d77e2d
Nov 07 02:42:36 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:36 devstack sudo[101249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.info
Nov 07 02:42:36 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:37 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b8cdc2dc-f56f-41cf-b10c-8d6bc1d41584 tempest-SnapshotsActionsTest-2075701007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.info" returned: 0 in 0.263s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:37 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b8cdc2dc-f56f-41cf-b10c-8d6bc1d41584 tempest-SnapshotsActionsTest-2075701007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.264s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-363da6a5-f6ab-4096-bcfa-1664c69d6ea6 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.d8c2c179-7ba0-4af8-9611-911a29d77e2d" returned: 0 in 0.431s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:37 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-363da6a5-f6ab-4096-bcfa-1664c69d6ea6 tempest-VolumesSnapshotTestJSON-1826004545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6de84f2-94af-45a9-95b7-2d2c06890d12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:42:37 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a74606-1ff7-4d15-b4cf-507ca3e488f9]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-363da6a5-f6ab-4096-bcfa-1664c69d6ea6 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:37 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b8cdc2dc-f56f-41cf-b10c-8d6bc1d41584 tempest-SnapshotsActionsTest-2075701007 None] Create snapshot completed successfully
Nov 07 02:42:37 devstack sudo[101255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12
Nov 07 02:42:37 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:37 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-363da6a5-f6ab-4096-bcfa-1664c69d6ea6 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12" returned: 0 in 0.537s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-363da6a5-f6ab-4096-bcfa-1664c69d6ea6 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.d8c2c179-7ba0-4af8-9611-911a29d77e2d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:37 devstack sudo[101261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.d8c2c179-7ba0-4af8-9611-911a29d77e2d
Nov 07 02:42:37 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:38 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-363da6a5-f6ab-4096-bcfa-1664c69d6ea6 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.d8c2c179-7ba0-4af8-9611-911a29d77e2d" returned: 0 in 0.381s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-363da6a5-f6ab-4096-bcfa-1664c69d6ea6 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.d8c2c179-7ba0-4af8-9611-911a29d77e2d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:38 devstack sudo[101267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.d8c2c179-7ba0-4af8-9611-911a29d77e2d
Nov 07 02:42:38 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:38 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-363da6a5-f6ab-4096-bcfa-1664c69d6ea6 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12.d8c2c179-7ba0-4af8-9611-911a29d77e2d" returned: 0 in 0.289s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:38 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-363da6a5-f6ab-4096-bcfa-1664c69d6ea6 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-d8c2c179-7ba0-4af8-9611-911a29d77e2d" released by "_delete_snapshot" :: held 1.797s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:38 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-363da6a5-f6ab-4096-bcfa-1664c69d6ea6 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-e6de84f2-94af-45a9-95b7-2d2c06890d12" released by "delete_snapshot" :: held 1.860s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:38 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-363da6a5-f6ab-4096-bcfa-1664c69d6ea6 tempest-VolumesSnapshotTestJSON-1826004545 None] Created reservations ['e5881902-afcb-4eef-89d1-cd6f9a27afe5', 'b28453fd-58c8-4eba-9ab2-2cd508312c7f', 'dc52778d-5862-459f-be3a-8d84e07ba28e', '29c94bb1-f032-4fa7-b990-ccc774566b51'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:42:38 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-363da6a5-f6ab-4096-bcfa-1664c69d6ea6 tempest-VolumesSnapshotTestJSON-1826004545 None] Delete snapshot completed successfully.
Nov 07 02:42:38 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-363da6a5-f6ab-4096-bcfa-1664c69d6ea6 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-d8c2c179-7ba0-4af8-9611-911a29d77e2d-delete_snapshot" released by "delete_snapshot" :: held 2.046s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-841e165b-e301-4f16-99cd-85c09f449b16 tempest-SnapshotsActionsTest-2075701007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-841e165b-e301-4f16-99cd-85c09f449b16 tempest-SnapshotsActionsTest-2075701007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-841e165b-e301-4f16-99cd-85c09f449b16 tempest-SnapshotsActionsTest-2075701007 None] Creating offline snapshot 2f8d838e-b4a5-48c5-9473-c111b8f6d79d of volume 802920cf-74b2-454f-9c77-19bb9b039f87 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:42:38 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d5eeac9c-2f44-429f-9c96-495b11169693 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "cinder-e6de84f2-94af-45a9-95b7-2d2c06890d12-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:38 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f35bd4-5ef0-40d1-aeec-a718eff75c01]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-841e165b-e301-4f16-99cd-85c09f449b16 tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:38 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d5eeac9c-2f44-429f-9c96-495b11169693 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-e6de84f2-94af-45a9-95b7-2d2c06890d12-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:38 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d5eeac9c-2f44-429f-9c96-495b11169693 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "cinder-quobyte-e6de84f2-94af-45a9-95b7-2d2c06890d12" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:38 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d5eeac9c-2f44-429f-9c96-495b11169693 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-e6de84f2-94af-45a9-95b7-2d2c06890d12" acquired by "delete_volume" :: waited 0.014s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:38 devstack sudo[101270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932
Nov 07 02:42:38 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:39 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd19d424-1125-471e-b49b-14f969ec5e78]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d5eeac9c-2f44-429f-9c96-495b11169693 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:39 devstack sudo[101272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12
Nov 07 02:42:39 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:39 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-841e165b-e301-4f16-99cd-85c09f449b16 tempest-SnapshotsActionsTest-2075701007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932" returned: 0 in 0.439s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-841e165b-e301-4f16-99cd-85c09f449b16 tempest-SnapshotsActionsTest-2075701007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-802920cf-74b2-454f-9c77-19bb9b039f87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:42:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-841e165b-e301-4f16-99cd-85c09f449b16 tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.2f8d838e-b4a5-48c5-9473-c111b8f6d79d 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:39 devstack sudo[101279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.2f8d838e-b4a5-48c5-9473-c111b8f6d79d 1G
Nov 07 02:42:39 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:39 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d5eeac9c-2f44-429f-9c96-495b11169693 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12" returned: 0 in 0.418s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d5eeac9c-2f44-429f-9c96-495b11169693 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:39 devstack sudo[101284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12
Nov 07 02:42:39 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:39 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d5eeac9c-2f44-429f-9c96-495b11169693 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e6de84f2-94af-45a9-95b7-2d2c06890d12" returned: 0 in 0.287s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:39 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d5eeac9c-2f44-429f-9c96-495b11169693 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-e6de84f2-94af-45a9-95b7-2d2c06890d12" released by "delete_volume" :: held 0.812s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:39 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-841e165b-e301-4f16-99cd-85c09f449b16 tempest-SnapshotsActionsTest-2075701007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.2f8d838e-b4a5-48c5-9473-c111b8f6d79d 1G" returned: 0 in 0.475s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-841e165b-e301-4f16-99cd-85c09f449b16 tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.2f8d838e-b4a5-48c5-9473-c111b8f6d79d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:39 devstack sudo[101291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.2f8d838e-b4a5-48c5-9473-c111b8f6d79d
Nov 07 02:42:39 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:39 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-d5eeac9c-2f44-429f-9c96-495b11169693 tempest-VolumesSnapshotTestJSON-1826004545 None] Created reservations ['a158b0d3-323b-4059-bce4-d9220b15f26e', 'c8c72b7c-3fe9-4075-91d2-fa60fb4ad459', '8f6ced23-e8df-4a18-8361-788c7bca060e', '7d0716b0-e68d-41b5-a24b-eab44639045e'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:42:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d5eeac9c-2f44-429f-9c96-495b11169693 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d5eeac9c-2f44-429f-9c96-495b11169693 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d5eeac9c-2f44-429f-9c96-495b11169693 tempest-VolumesSnapshotTestJSON-1826004545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d5eeac9c-2f44-429f-9c96-495b11169693 tempest-VolumesSnapshotTestJSON-1826004545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d5eeac9c-2f44-429f-9c96-495b11169693 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d5eeac9c-2f44-429f-9c96-495b11169693 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:39 devstack sudo[101293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:42:39 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:40 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-841e165b-e301-4f16-99cd-85c09f449b16 tempest-SnapshotsActionsTest-2075701007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.2f8d838e-b4a5-48c5-9473-c111b8f6d79d" returned: 0 in 0.394s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:40 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-841e165b-e301-4f16-99cd-85c09f449b16 tempest-SnapshotsActionsTest-2075701007 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.2f8d838e-b4a5-48c5-9473-c111b8f6d79d is being set with open permissions: ugo+rw
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-841e165b-e301-4f16-99cd-85c09f449b16 tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.2f8d838e-b4a5-48c5-9473-c111b8f6d79d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:40 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d5eeac9c-2f44-429f-9c96-495b11169693 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.298s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-d5eeac9c-2f44-429f-9c96-495b11169693 tempest-VolumesSnapshotTestJSON-1826004545 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:42:40 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-d5eeac9c-2f44-429f-9c96-495b11169693 tempest-VolumesSnapshotTestJSON-1826004545 None] Deleted volume successfully.
Nov 07 02:42:40 devstack sudo[101299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.2f8d838e-b4a5-48c5-9473-c111b8f6d79d
Nov 07 02:42:40 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d5eeac9c-2f44-429f-9c96-495b11169693 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-e6de84f2-94af-45a9-95b7-2d2c06890d12-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:40 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-841e165b-e301-4f16-99cd-85c09f449b16 tempest-SnapshotsActionsTest-2075701007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.2f8d838e-b4a5-48c5-9473-c111b8f6d79d" returned: 0 in 0.315s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-841e165b-e301-4f16-99cd-85c09f449b16 tempest-SnapshotsActionsTest-2075701007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.763s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:40 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-841e165b-e301-4f16-99cd-85c09f449b16 tempest-SnapshotsActionsTest-2075701007 None] Create snapshot completed successfully
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Flow 'volume_create_manager' (c034110b-4a07-4cd3-bf19-783d592e5a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e23f56-4f78-4289-b471-fc0b97981289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e23f56-4f78-4289-b471-fc0b97981289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-982192878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c44357b5-d0bd-4edb-9086-dce2764a49b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b0dcfc2e33442eb75c4b4a9cd2dfc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:42:41Z,use_quota=True,user_id='f542c67d624d4235b358f08e2e5005ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (458c5cd0-396e-4622-b512-a93ab0928a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (458c5cd0-396e-4622-b512-a93ab0928a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f64fd23-8a54-4679-bf44-2bc8688a90da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f64fd23-8a54-4679-bf44-2bc8688a90da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c44357b5-d0bd-4edb-9086-dce2764a49b5', 'volume_name': 'volume-c44357b5-d0bd-4edb-9086-dce2764a49b5', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b91b28-aed5-453a-a293-15a764248982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b91b28-aed5-453a-a293-15a764248982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec42bdd-a06d-42a5-bc2b-a7af668b3f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:40 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Volume c44357b5-d0bd-4edb-9086-dce2764a49b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c44357b5-d0bd-4edb-9086-dce2764a49b5', 'volume_size': 1}
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-982192878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c44357b5-d0bd-4edb-9086-dce2764a49b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b0dcfc2e33442eb75c4b4a9cd2dfc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:42:41Z,use_quota=True,user_id='f542c67d624d4235b358f08e2e5005ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Creating volume c44357b5-d0bd-4edb-9086-dce2764a49b5 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:42:40 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:42:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:40 devstack sudo[101302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5 1073741824
Nov 07 02:42:40 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f274f280-15ba-470e-8520-a6a0fb625819 tempest-SnapshotsActionsTest-197122187 None] Acquiring lock "cinder-2f8d838e-b4a5-48c5-9473-c111b8f6d79d-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f274f280-15ba-470e-8520-a6a0fb625819 tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-2f8d838e-b4a5-48c5-9473-c111b8f6d79d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f274f280-15ba-470e-8520-a6a0fb625819 tempest-SnapshotsActionsTest-197122187 None] Acquiring lock "cinder-quobyte-802920cf-74b2-454f-9c77-19bb9b039f87" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f274f280-15ba-470e-8520-a6a0fb625819 tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-quobyte-802920cf-74b2-454f-9c77-19bb9b039f87" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f274f280-15ba-470e-8520-a6a0fb625819 tempest-SnapshotsActionsTest-197122187 None] Acquiring lock "cinder-quobyte-2f8d838e-b4a5-48c5-9473-c111b8f6d79d" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f274f280-15ba-470e-8520-a6a0fb625819 tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-quobyte-2f8d838e-b4a5-48c5-9473-c111b8f6d79d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-f274f280-15ba-470e-8520-a6a0fb625819 tempest-SnapshotsActionsTest-197122187 None] Deleting offline snapshot 2f8d838e-b4a5-48c5-9473-c111b8f6d79d of volume 802920cf-74b2-454f-9c77-19bb9b039f87 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-f274f280-15ba-470e-8520-a6a0fb625819 tempest-SnapshotsActionsTest-197122187 None] snapshot_file for this snap is: volume-802920cf-74b2-454f-9c77-19bb9b039f87.2f8d838e-b4a5-48c5-9473-c111b8f6d79d {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b27627-de26-4267-bec7-f428b45d032f]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f274f280-15ba-470e-8520-a6a0fb625819 tempest-SnapshotsActionsTest-197122187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.2f8d838e-b4a5-48c5-9473-c111b8f6d79d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:41 devstack sudo[101307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.2f8d838e-b4a5-48c5-9473-c111b8f6d79d
Nov 07 02:42:41 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:41 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5 1073741824" returned: 0 in 0.533s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:41 devstack sudo[101310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5
Nov 07 02:42:41 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:41 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f274f280-15ba-470e-8520-a6a0fb625819 tempest-SnapshotsActionsTest-197122187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.2f8d838e-b4a5-48c5-9473-c111b8f6d79d" returned: 0 in 0.399s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-f274f280-15ba-470e-8520-a6a0fb625819 tempest-SnapshotsActionsTest-197122187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-802920cf-74b2-454f-9c77-19bb9b039f87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:42:41 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5" returned: 0 in 0.262s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[528f2f94-039c-49b9-afd9-2c37e396c318]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f274f280-15ba-470e-8520-a6a0fb625819 tempest-SnapshotsActionsTest-197122187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec42bdd-a06d-42a5-bc2b-a7af668b3f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c44357b5-d0bd-4edb-9086-dce2764a49b5', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773de179-fcac-494a-b93d-f73ac473c0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:41 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Volume volume-c44357b5-d0bd-4edb-9086-dce2764a49b5 (c44357b5-d0bd-4edb-9086-dce2764a49b5): created successfully
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773de179-fcac-494a-b93d-f73ac473c0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Flow 'volume_create_manager' (c034110b-4a07-4cd3-bf19-783d592e5a61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:41 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-87325ad5-0fff-42b5-aad1-b598872a73bb tempest-VolumesSnapshotTestJSON-1826004545 None] Created volume successfully.
Nov 07 02:42:41 devstack sudo[101317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932
Nov 07 02:42:41 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:41 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f274f280-15ba-470e-8520-a6a0fb625819 tempest-SnapshotsActionsTest-197122187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932" returned: 0 in 0.392s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-f274f280-15ba-470e-8520-a6a0fb625819 tempest-SnapshotsActionsTest-197122187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-802920cf-74b2-454f-9c77-19bb9b039f87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:42:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f274f280-15ba-470e-8520-a6a0fb625819 tempest-SnapshotsActionsTest-197122187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.2f8d838e-b4a5-48c5-9473-c111b8f6d79d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:42 devstack sudo[101324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.2f8d838e-b4a5-48c5-9473-c111b8f6d79d
Nov 07 02:42:42 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:42 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f274f280-15ba-470e-8520-a6a0fb625819 tempest-SnapshotsActionsTest-197122187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.2f8d838e-b4a5-48c5-9473-c111b8f6d79d" returned: 0 in 0.394s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f274f280-15ba-470e-8520-a6a0fb625819 tempest-SnapshotsActionsTest-197122187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.2f8d838e-b4a5-48c5-9473-c111b8f6d79d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:42 devstack sudo[101330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.2f8d838e-b4a5-48c5-9473-c111b8f6d79d
Nov 07 02:42:42 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:42 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f274f280-15ba-470e-8520-a6a0fb625819 tempest-SnapshotsActionsTest-197122187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.2f8d838e-b4a5-48c5-9473-c111b8f6d79d" returned: 0 in 0.246s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:42 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f274f280-15ba-470e-8520-a6a0fb625819 tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-quobyte-2f8d838e-b4a5-48c5-9473-c111b8f6d79d" released by "_delete_snapshot" :: held 1.552s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:42 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f274f280-15ba-470e-8520-a6a0fb625819 tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-quobyte-802920cf-74b2-454f-9c77-19bb9b039f87" released by "delete_snapshot" :: held 1.577s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:42 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-f274f280-15ba-470e-8520-a6a0fb625819 tempest-SnapshotsActionsTest-197122187 None] Created reservations ['daba20cd-f1f9-4d6a-93ea-1d3bbc13e896', 'cd352e18-31f6-4611-b4af-35e6577e36c2', 'a903be88-e355-4d22-8112-090678d8f1fb', 'bac4d95b-62af-4a19-841c-471e08019272'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:42:42 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f274f280-15ba-470e-8520-a6a0fb625819 tempest-SnapshotsActionsTest-197122187 None] Delete snapshot completed successfully.
Nov 07 02:42:42 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f274f280-15ba-470e-8520-a6a0fb625819 tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-2f8d838e-b4a5-48c5-9473-c111b8f6d79d-delete_snapshot" released by "delete_snapshot" :: held 1.746s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8fb39a49-486d-463d-bb50-554addf0074f tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8fb39a49-486d-463d-bb50-554addf0074f tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:42 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-8fb39a49-486d-463d-bb50-554addf0074f tempest-VolumesSnapshotTestJSON-1826004545 None] Creating offline snapshot f2a39758-11a9-40e5-a9fa-6180dfe33353 of volume c44357b5-d0bd-4edb-9086-dce2764a49b5 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:42:42 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[0def43ae-e980-4ebf-8da8-8e9e779adbd2]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8fb39a49-486d-463d-bb50-554addf0074f tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:43 devstack sudo[101333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5
Nov 07 02:42:43 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:43 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8fb39a49-486d-463d-bb50-554addf0074f tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5" returned: 0 in 0.399s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8fb39a49-486d-463d-bb50-554addf0074f tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.f2a39758-11a9-40e5-a9fa-6180dfe33353 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:43 devstack sudo[101339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.f2a39758-11a9-40e5-a9fa-6180dfe33353 1G
Nov 07 02:42:43 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1907d030-cbc9-46e1-843f-5e327763c8d0 tempest-SnapshotsActionsTest-2075701007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:43 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:42:43 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Flow 'volume_create_manager' (2b2c8639-2da6-42e3-9e5c-3ef37fb46025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08835afb-190f-46f9-b07f-a05699f5dbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8fb39a49-486d-463d-bb50-554addf0074f tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.f2a39758-11a9-40e5-a9fa-6180dfe33353 1G" returned: 0 in 0.473s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8fb39a49-486d-463d-bb50-554addf0074f tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c44357b5-d0bd-4edb-9086-dce2764a49b5 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.f2a39758-11a9-40e5-a9fa-6180dfe33353 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08835afb-190f-46f9-b07f-a05699f5dbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3467ea4-f8b8-4c13-9270-eeb81bf28031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='969ab18f66754a55a001b66e057e8453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:42:44Z,use_quota=True,user_id='c07bbac0bdaa40feb604df1c26f0d1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98708470-6d13-4a49-a050-cf3516969540),volume_type_id=98708470-6d13-4a49-a050-cf3516969540)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:43 devstack sudo[101345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c44357b5-d0bd-4edb-9086-dce2764a49b5 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.f2a39758-11a9-40e5-a9fa-6180dfe33353
Nov 07 02:42:43 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68438858-07d4-460b-8dec-db4205b5535b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68438858-07d4-460b-8dec-db4205b5535b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec34d0f3-0c23-4979-9208-0090b3b2146c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:43 devstack cinder-volume[87054]: DEBUG cinder.image.glance [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Creating Keystone auth plugin from conf {{(pid=87054) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 07 02:42:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec34d0f3-0c23-4979-9208-0090b3b2146c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b3467ea4-f8b8-4c13-9270-eeb81bf28031', 'volume_name': 'volume-b3467ea4-f8b8-4c13-9270-eeb81bf28031', 'volume_size': 1, 'image_id': '17f6ba26-a76c-4057-8420-6a99115491ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/17f6ba26-a76c-4057-8420-6a99115491ed', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '87dafd085e60a94df3b873f0aef9b0b3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '969ab18f66754a55a001b66e057e8453', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4f96b7dceabe48c9797411f4a02e7e2c6cefb261c433502cc49f29d6a7890ce67cf59a9e9e6960814449b85adf5188e938eefe2ebabe60bc3fa1e469fd3e7536', 'id': '17f6ba26-a76c-4057-8420-6a99115491ed', 'created_at': datetime.datetime(2026, 11, 7, 1, 42, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 42, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/17f6ba26-a76c-4057-8420-6a99115491ed/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72170a01de50>}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2002bd09-ddb9-446e-8da7-2f731c2f18f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2002bd09-ddb9-446e-8da7-2f731c2f18f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d61fee-dc8b-4caf-b442-1923a4ea7010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:44 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Volume b3467ea4-f8b8-4c13-9270-eeb81bf28031: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b3467ea4-f8b8-4c13-9270-eeb81bf28031', 'volume_size': 1, 'image_id': '17f6ba26-a76c-4057-8420-6a99115491ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/17f6ba26-a76c-4057-8420-6a99115491ed', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '87dafd085e60a94df3b873f0aef9b0b3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '969ab18f66754a55a001b66e057e8453', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4f96b7dceabe48c9797411f4a02e7e2c6cefb261c433502cc49f29d6a7890ce67cf59a9e9e6960814449b85adf5188e938eefe2ebabe60bc3fa1e469fd3e7536', 'id': '17f6ba26-a76c-4057-8420-6a99115491ed', 'created_at': datetime.datetime(2026, 11, 7, 1, 42, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 42, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/17f6ba26-a76c-4057-8420-6a99115491ed/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72170a01de50>}
Nov 07 02:42:44 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Trying to clone b3467ea4-f8b8-4c13-9270-eeb81bf28031 from image 17f6ba26-a76c-4057-8420-6a99115491ed at location (None, [{'url': 'file:///opt/stack/data/glance/images/17f6ba26-a76c-4057-8420-6a99115491ed', 'metadata': {}}]). {{(pid=87054) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 07 02:42:44 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8fb39a49-486d-463d-bb50-554addf0074f tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c44357b5-d0bd-4edb-9086-dce2764a49b5 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.f2a39758-11a9-40e5-a9fa-6180dfe33353" returned: 0 in 0.299s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:44 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-8fb39a49-486d-463d-bb50-554addf0074f tempest-VolumesSnapshotTestJSON-1826004545 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.f2a39758-11a9-40e5-a9fa-6180dfe33353 is being set with open permissions: ugo+rw
Nov 07 02:42:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8fb39a49-486d-463d-bb50-554addf0074f tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.f2a39758-11a9-40e5-a9fa-6180dfe33353 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:44 devstack sudo[101350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.f2a39758-11a9-40e5-a9fa-6180dfe33353
Nov 07 02:42:44 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:44 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 07 02:42:44 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Image download 0.00 MB at 0.00 MB/s
Nov 07 02:42:44 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52854b0-66fa-48fa-a5fa-d827c40a995b]: (4, 'raw') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:44 devstack sudo[101352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD
Nov 07 02:42:44 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:44 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8fb39a49-486d-463d-bb50-554addf0074f tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.f2a39758-11a9-40e5-a9fa-6180dfe33353" returned: 0 in 0.248s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8fb39a49-486d-463d-bb50-554addf0074f tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:44 devstack sudo[101355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.info
Nov 07 02:42:44 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:44 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:44 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8fb39a49-486d-463d-bb50-554addf0074f tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.info" returned: 0 in 0.274s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:44 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-8fb39a49-486d-463d-bb50-554addf0074f tempest-VolumesSnapshotTestJSON-1826004545 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.info is being set with open permissions: ugo+rw
Nov 07 02:42:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8fb39a49-486d-463d-bb50-554addf0074f tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:44 devstack sudo[101359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD
Nov 07 02:42:44 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:44 devstack sudo[101362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.info
Nov 07 02:42:44 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:44 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD" returned: 1 in 0.374s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:42:44 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Temporary image 17f6ba26-a76c-4057-8420-6a99115491ed is fetched for user c07bbac0bdaa40feb604df1c26f0d1f2. {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 07 02:42:45 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8fb39a49-486d-463d-bb50-554addf0074f tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.info" returned: 0 in 0.313s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8fb39a49-486d-463d-bb50-554addf0074f tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.100s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1907d030-cbc9-46e1-843f-5e327763c8d0 tempest-SnapshotsActionsTest-2075701007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.521s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-1907d030-cbc9-46e1-843f-5e327763c8d0 tempest-SnapshotsActionsTest-2075701007 None] Creating offline snapshot 86d766e4-b9d2-47d8-b07c-d44a7c517e06 of volume 802920cf-74b2-454f-9c77-19bb9b039f87 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:42:45 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[da30b9de-fddd-45bf-866a-091786327933]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1907d030-cbc9-46e1-843f-5e327763c8d0 tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:45 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-8fb39a49-486d-463d-bb50-554addf0074f tempest-VolumesSnapshotTestJSON-1826004545 None] Create snapshot completed successfully
Nov 07 02:42:45 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1f214f-ba85-4ef4-a72e-3aeee4f8b32d]: (4, 'raw') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:45 devstack sudo[101369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932
Nov 07 02:42:45 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:45 devstack sudo[101370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD
Nov 07 02:42:45 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:45 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD" returned: 0 in 0.322s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:45 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1907d030-cbc9-46e1-843f-5e327763c8d0 tempest-SnapshotsActionsTest-2075701007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932" returned: 0 in 0.357s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-1907d030-cbc9-46e1-843f-5e327763c8d0 tempest-SnapshotsActionsTest-2075701007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-802920cf-74b2-454f-9c77-19bb9b039f87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:42:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1907d030-cbc9-46e1-843f-5e327763c8d0 tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.86d766e4-b9d2-47d8-b07c-d44a7c517e06 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:45 devstack sudo[101379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.86d766e4-b9d2-47d8-b07c-d44a7c517e06 1G
Nov 07 02:42:45 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:45 devstack sudo[101378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD
Nov 07 02:42:45 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:45 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD" returned: 1 in 0.330s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:42:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:45 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1907d030-cbc9-46e1-843f-5e327763c8d0 tempest-SnapshotsActionsTest-2075701007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.86d766e4-b9d2-47d8-b07c-d44a7c517e06 1G" returned: 0 in 0.450s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1907d030-cbc9-46e1-843f-5e327763c8d0 tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.86d766e4-b9d2-47d8-b07c-d44a7c517e06 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:45 devstack sudo[101389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.86d766e4-b9d2-47d8-b07c-d44a7c517e06
Nov 07 02:42:45 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:46 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1907d030-cbc9-46e1-843f-5e327763c8d0 tempest-SnapshotsActionsTest-2075701007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.86d766e4-b9d2-47d8-b07c-d44a7c517e06" returned: 0 in 0.297s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:46 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-1907d030-cbc9-46e1-843f-5e327763c8d0 tempest-SnapshotsActionsTest-2075701007 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.86d766e4-b9d2-47d8-b07c-d44a7c517e06 is being set with open permissions: ugo+rw
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1907d030-cbc9-46e1-843f-5e327763c8d0 tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.86d766e4-b9d2-47d8-b07c-d44a7c517e06 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:46 devstack sudo[101394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.86d766e4-b9d2-47d8-b07c-d44a7c517e06
Nov 07 02:42:46 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:46 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1907d030-cbc9-46e1-843f-5e327763c8d0 tempest-SnapshotsActionsTest-2075701007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.86d766e4-b9d2-47d8-b07c-d44a7c517e06" returned: 0 in 0.252s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1907d030-cbc9-46e1-843f-5e327763c8d0 tempest-SnapshotsActionsTest-2075701007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.472s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.724s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3467ea4-f8b8-4c13-9270-eeb81bf28031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='969ab18f66754a55a001b66e057e8453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:42:44Z,use_quota=True,user_id='c07bbac0bdaa40feb604df1c26f0d1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98708470-6d13-4a49-a050-cf3516969540),volume_type_id=98708470-6d13-4a49-a050-cf3516969540)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Creating volume b3467ea4-f8b8-4c13-9270-eeb81bf28031 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:42:46 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b3467ea4-f8b8-4c13-9270-eeb81bf28031 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:46 devstack sudo[101397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b3467ea4-f8b8-4c13-9270-eeb81bf28031 1073741824
Nov 07 02:42:46 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:42:46 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-1907d030-cbc9-46e1-843f-5e327763c8d0 tempest-SnapshotsActionsTest-2075701007 None] Create snapshot completed successfully
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Flow 'volume_create_manager' (3a88c798-bfa5-49d4-841f-cb5f874b3be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4ce9e5-13df-4908-a0a3-f9c60f0c2469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4ce9e5-13df-4908-a0a3-f9c60f0c2469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2026799465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4decf42-a20a-404f-b6c1-5c4558c1d3d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b0dcfc2e33442eb75c4b4a9cd2dfc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f2a39758-11a9-40e5-a9fa-6180dfe33353,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:42:47Z,use_quota=True,user_id='f542c67d624d4235b358f08e2e5005ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684c19b4-45eb-4cea-ab53-920254acddbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684c19b4-45eb-4cea-ab53-920254acddbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32bec240-4f5e-4a84-841d-8d422188f931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32bec240-4f5e-4a84-841d-8d422188f931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd4decf42-a20a-404f-b6c1-5c4558c1d3d7', 'volume_name': 'volume-d4decf42-a20a-404f-b6c1-5c4558c1d3d7', 'volume_size': 1, 'snapshot_id': 'f2a39758-11a9-40e5-a9fa-6180dfe33353'}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20dfb152-4cd7-46a6-85cd-6436df8f7d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20dfb152-4cd7-46a6-85cd-6436df8f7d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc4ac2e-bf26-4a66-8108-620046db3fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:46 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Volume d4decf42-a20a-404f-b6c1-5c4558c1d3d7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d4decf42-a20a-404f-b6c1-5c4558c1d3d7', 'volume_size': 1, 'snapshot_id': 'f2a39758-11a9-40e5-a9fa-6180dfe33353'}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-778c5e00-ce2c-4e12-a11b-db93ee4ea915 tempest-SnapshotsActionsTest-197122187 None] Acquiring lock "cinder-86d766e4-b9d2-47d8-b07c-d44a7c517e06-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-778c5e00-ce2c-4e12-a11b-db93ee4ea915 tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-86d766e4-b9d2-47d8-b07c-d44a7c517e06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-778c5e00-ce2c-4e12-a11b-db93ee4ea915 tempest-SnapshotsActionsTest-197122187 None] Acquiring lock "cinder-quobyte-802920cf-74b2-454f-9c77-19bb9b039f87" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-778c5e00-ce2c-4e12-a11b-db93ee4ea915 tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-quobyte-802920cf-74b2-454f-9c77-19bb9b039f87" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-778c5e00-ce2c-4e12-a11b-db93ee4ea915 tempest-SnapshotsActionsTest-197122187 None] Acquiring lock "cinder-quobyte-86d766e4-b9d2-47d8-b07c-d44a7c517e06" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-778c5e00-ce2c-4e12-a11b-db93ee4ea915 tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-quobyte-86d766e4-b9d2-47d8-b07c-d44a7c517e06" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-778c5e00-ce2c-4e12-a11b-db93ee4ea915 tempest-SnapshotsActionsTest-197122187 None] Deleting offline snapshot 86d766e4-b9d2-47d8-b07c-d44a7c517e06 of volume 802920cf-74b2-454f-9c77-19bb9b039f87 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-778c5e00-ce2c-4e12-a11b-db93ee4ea915 tempest-SnapshotsActionsTest-197122187 None] snapshot_file for this snap is: volume-802920cf-74b2-454f-9c77-19bb9b039f87.86d766e4-b9d2-47d8-b07c-d44a7c517e06 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdaf2499-6d1b-4e0b-babb-a8ee8be467fc]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-778c5e00-ce2c-4e12-a11b-db93ee4ea915 tempest-SnapshotsActionsTest-197122187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.86d766e4-b9d2-47d8-b07c-d44a7c517e06 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:47 devstack sudo[101402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.86d766e4-b9d2-47d8-b07c-d44a7c517e06
Nov 07 02:42:47 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:47 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b3467ea4-f8b8-4c13-9270-eeb81bf28031 1073741824" returned: 0 in 0.513s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b3467ea4-f8b8-4c13-9270-eeb81bf28031 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:47 devstack sudo[101405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b3467ea4-f8b8-4c13-9270-eeb81bf28031
Nov 07 02:42:47 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:47 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-778c5e00-ce2c-4e12-a11b-db93ee4ea915 tempest-SnapshotsActionsTest-197122187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.86d766e4-b9d2-47d8-b07c-d44a7c517e06" returned: 0 in 0.395s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-778c5e00-ce2c-4e12-a11b-db93ee4ea915 tempest-SnapshotsActionsTest-197122187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-802920cf-74b2-454f-9c77-19bb9b039f87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dda834-911f-416f-8634-7bbf6fc3c8c5]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-778c5e00-ce2c-4e12-a11b-db93ee4ea915 tempest-SnapshotsActionsTest-197122187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:47 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b3467ea4-f8b8-4c13-9270-eeb81bf28031" returned: 0 in 0.260s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.649s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "cinder-quobyte-f2a39758-11a9-40e5-a9fa-6180dfe33353-d4decf42-a20a-404f-b6c1-5c4558c1d3d7" by "_create_volume_from_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-f2a39758-11a9-40e5-a9fa-6180dfe33353-d4decf42-a20a-404f-b6c1-5c4558c1d3d7" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Creating volume d4decf42-a20a-404f-b6c1-5c4558c1d3d7 from snapshot f2a39758-11a9-40e5-a9fa-6180dfe33353 {{(pid=87054) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "cinder-quobyte-d4decf42-a20a-404f-b6c1-5c4558c1d3d7" by "_copy_volume_from_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Attempting download of 17f6ba26-a76c-4057-8420-6a99115491ed ((None, [{'url': 'file:///opt/stack/data/glance/images/17f6ba26-a76c-4057-8420-6a99115491ed', 'metadata': {}}])) to volume b3467ea4-f8b8-4c13-9270-eeb81bf28031. {{(pid=87054) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 07 02:42:47 devstack sudo[101411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932
Nov 07 02:42:47 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-d4decf42-a20a-404f-b6c1-5c4558c1d3d7" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] snapshot: f2a39758-11a9-40e5-a9fa-6180dfe33353, volume: d4decf42-a20a-404f-b6c1-5c4558c1d3d7,  {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[24924797-64e1-4211-b3f4-75987f381340]: (4, 'raw') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a232c0-1787-4dc2-bd91-c5565a4c9278]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_17f6ba26-a76c-4057-8420-6a99115491ed_goutbc1l {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.f2a39758-11a9-40e5-a9fa-6180dfe33353 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:47 devstack sudo[101414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_17f6ba26-a76c-4057-8420-6a99115491ed_goutbc1l
Nov 07 02:42:47 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:47 devstack sudo[101415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.f2a39758-11a9-40e5-a9fa-6180dfe33353
Nov 07 02:42:47 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:47 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-778c5e00-ce2c-4e12-a11b-db93ee4ea915 tempest-SnapshotsActionsTest-197122187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932" returned: 0 in 0.397s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-778c5e00-ce2c-4e12-a11b-db93ee4ea915 tempest-SnapshotsActionsTest-197122187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-802920cf-74b2-454f-9c77-19bb9b039f87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-778c5e00-ce2c-4e12-a11b-db93ee4ea915 tempest-SnapshotsActionsTest-197122187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.86d766e4-b9d2-47d8-b07c-d44a7c517e06 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:47 devstack sudo[101421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.86d766e4-b9d2-47d8-b07c-d44a7c517e06
Nov 07 02:42:47 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:47 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_17f6ba26-a76c-4057-8420-6a99115491ed_goutbc1l" returned: 0 in 0.346s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17f6ba26-a76c-4057-8420-6a99115491ed_goutbc1l {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:47 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.f2a39758-11a9-40e5-a9fa-6180dfe33353" returned: 0 in 0.474s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c44357b5-d0bd-4edb-9086-dce2764a49b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:42:47 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe09670-c6a1-48d2-bf5f-6fcf2bfb9732]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:48 devstack sudo[101428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17f6ba26-a76c-4057-8420-6a99115491ed_goutbc1l
Nov 07 02:42:48 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:48 devstack sudo[101434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5
Nov 07 02:42:48 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:48 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-778c5e00-ce2c-4e12-a11b-db93ee4ea915 tempest-SnapshotsActionsTest-197122187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.86d766e4-b9d2-47d8-b07c-d44a7c517e06" returned: 0 in 0.431s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-778c5e00-ce2c-4e12-a11b-db93ee4ea915 tempest-SnapshotsActionsTest-197122187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.86d766e4-b9d2-47d8-b07c-d44a7c517e06 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:48 devstack sudo[101440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.86d766e4-b9d2-47d8-b07c-d44a7c517e06
Nov 07 02:42:48 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:48 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17f6ba26-a76c-4057-8420-6a99115491ed_goutbc1l" returned: 1 in 0.406s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17f6ba26-a76c-4057-8420-6a99115491ed_goutbc1l' failed. Not Retrying. {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:42:48 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c5c17f-0a5d-4430-8c9d-24494c703399]: (4, 'raw') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:48 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5" returned: 0 in 0.358s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5 {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:42:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Creating direct copy from snapshot {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:42:48 devstack cinder-volume[87054]: DEBUG cinder.utils [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Path /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d4decf42-a20a-404f-b6c1-5c4558c1d3d7 not found in is_blk_device check {{(pid=87054) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:42:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d4decf42-a20a-404f-b6c1-5c4558c1d3d7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:48 devstack sudo[101444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD
Nov 07 02:42:48 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:48 devstack sudo[101450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d4decf42-a20a-404f-b6c1-5c4558c1d3d7
Nov 07 02:42:48 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:48 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-778c5e00-ce2c-4e12-a11b-db93ee4ea915 tempest-SnapshotsActionsTest-197122187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.86d766e4-b9d2-47d8-b07c-d44a7c517e06" returned: 0 in 0.280s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-778c5e00-ce2c-4e12-a11b-db93ee4ea915 tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-quobyte-86d766e4-b9d2-47d8-b07c-d44a7c517e06" released by "_delete_snapshot" :: held 1.620s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-778c5e00-ce2c-4e12-a11b-db93ee4ea915 tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-quobyte-802920cf-74b2-454f-9c77-19bb9b039f87" released by "delete_snapshot" :: held 1.648s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:48 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-778c5e00-ce2c-4e12-a11b-db93ee4ea915 tempest-SnapshotsActionsTest-197122187 None] Created reservations ['311c022a-387a-4747-bdf7-67eff20268a6', '28b5b3ae-538a-4bf8-82fd-cf3163f39158', 'fd014751-ee7b-4f2f-b487-e038fd55b041', '0dd32723-f72d-479c-8e7e-1e5d2a79c4fd'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:42:48 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-778c5e00-ce2c-4e12-a11b-db93ee4ea915 tempest-SnapshotsActionsTest-197122187 None] Delete snapshot completed successfully.
Nov 07 02:42:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-778c5e00-ce2c-4e12-a11b-db93ee4ea915 tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-86d766e4-b9d2-47d8-b07c-d44a7c517e06-delete_snapshot" released by "delete_snapshot" :: held 1.808s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:48 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:48 devstack sudo[101456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD
Nov 07 02:42:48 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:49 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD" returned: 1 in 0.523s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:42:49 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] 17f6ba26-a76c-4057-8420-6a99115491ed was raw, converting to qcow2 {{(pid=87054) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 07 02:42:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b3467ea4-f8b8-4c13-9270-eeb81bf28031 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:49 devstack sudo[101469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b3467ea4-f8b8-4c13-9270-eeb81bf28031
Nov 07 02:42:49 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d2b79651-21db-4d28-b854-0d613800382e tempest-SnapshotsActionsTest-2075701007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:50 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b3467ea4-f8b8-4c13-9270-eeb81bf28031" returned: 0 in 1.046s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:50 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_17f6ba26-a76c-4057-8420-6a99115491ed_qiqbvajmdevstack@QuobyteHD, size 0.00 MB, duration 1.05 sec, destination /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b3467ea4-f8b8-4c13-9270-eeb81bf28031 {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:42:50 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Converted 0.00 MB image at 0.00 MB/s
Nov 07 02:42:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b3467ea4-f8b8-4c13-9270-eeb81bf28031 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:50 devstack sudo[101475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b3467ea4-f8b8-4c13-9270-eeb81bf28031 1G
Nov 07 02:42:50 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:50 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b3467ea4-f8b8-4c13-9270-eeb81bf28031 1G" returned: 0 in 0.625s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:50 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Downloaded image 17f6ba26-a76c-4057-8420-6a99115491ed ((None, [{'url': 'file:///opt/stack/data/glance/images/17f6ba26-a76c-4057-8420-6a99115491ed', 'metadata': {}}])) to volume b3467ea4-f8b8-4c13-9270-eeb81bf28031 successfully. {{(pid=87054) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 07 02:42:50 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Temporary image 17f6ba26-a76c-4057-8420-6a99115491ed for user c07bbac0bdaa40feb604df1c26f0d1f2 is deleted. {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 07 02:42:50 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Marking volume b3467ea4-f8b8-4c13-9270-eeb81bf28031 as bootable. {{(pid=87054) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 07 02:42:50 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Copying metadata from image 17f6ba26-a76c-4057-8420-6a99115491ed to b3467ea4-f8b8-4c13-9270-eeb81bf28031. {{(pid=87054) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 07 02:42:50 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Creating volume glance metadata for volume b3467ea4-f8b8-4c13-9270-eeb81bf28031 backed by image 17f6ba26-a76c-4057-8420-6a99115491ed with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '17f6ba26-a76c-4057-8420-6a99115491ed', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '87dafd085e60a94df3b873f0aef9b0b3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87054) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 07 02:42:51 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d61fee-dc8b-4caf-b442-1923a4ea7010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3467ea4-f8b8-4c13-9270-eeb81bf28031', 'volume_size': 1, 'image_id': '17f6ba26-a76c-4057-8420-6a99115491ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/17f6ba26-a76c-4057-8420-6a99115491ed', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '87dafd085e60a94df3b873f0aef9b0b3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '969ab18f66754a55a001b66e057e8453', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4f96b7dceabe48c9797411f4a02e7e2c6cefb261c433502cc49f29d6a7890ce67cf59a9e9e6960814449b85adf5188e938eefe2ebabe60bc3fa1e469fd3e7536', 'id': '17f6ba26-a76c-4057-8420-6a99115491ed', 'created_at': datetime.datetime(2026, 11, 7, 1, 42, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 42, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/17f6ba26-a76c-4057-8420-6a99115491ed/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72170a01de50>}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:51 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8051456c-f8e3-4378-b043-f65348193e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:51 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Volume volume-b3467ea4-f8b8-4c13-9270-eeb81bf28031 (b3467ea4-f8b8-4c13-9270-eeb81bf28031): created successfully
Nov 07 02:42:51 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8051456c-f8e3-4378-b043-f65348193e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:51 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Flow 'volume_create_manager' (2b2c8639-2da6-42e3-9e5c-3ef37fb46025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:51 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b9da5126-56e0-4356-af12-981d26968ecc tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Created volume successfully.
Nov 07 02:42:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6c49de26-bec8-4f7a-8167-29163a2d883c tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Acquiring lock "cinder-b3467ea4-f8b8-4c13-9270-eeb81bf28031-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6c49de26-bec8-4f7a-8167-29163a2d883c tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Lock "cinder-b3467ea4-f8b8-4c13-9270-eeb81bf28031-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6c49de26-bec8-4f7a-8167-29163a2d883c tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Acquiring lock "cinder-quobyte-b3467ea4-f8b8-4c13-9270-eeb81bf28031" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6c49de26-bec8-4f7a-8167-29163a2d883c tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Lock "cinder-quobyte-b3467ea4-f8b8-4c13-9270-eeb81bf28031" acquired by "delete_volume" :: waited 0.025s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:51 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f97a591-4420-48a0-a420-00d07269c1ce]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6c49de26-bec8-4f7a-8167-29163a2d883c tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b3467ea4-f8b8-4c13-9270-eeb81bf28031 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:51 devstack sudo[101481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b3467ea4-f8b8-4c13-9270-eeb81bf28031
Nov 07 02:42:51 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:52 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6c49de26-bec8-4f7a-8167-29163a2d883c tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b3467ea4-f8b8-4c13-9270-eeb81bf28031" returned: 0 in 0.673s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6c49de26-bec8-4f7a-8167-29163a2d883c tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b3467ea4-f8b8-4c13-9270-eeb81bf28031 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:52 devstack sudo[101486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b3467ea4-f8b8-4c13-9270-eeb81bf28031
Nov 07 02:42:52 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:52 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6c49de26-bec8-4f7a-8167-29163a2d883c tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b3467ea4-f8b8-4c13-9270-eeb81bf28031" returned: 0 in 0.362s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6c49de26-bec8-4f7a-8167-29163a2d883c tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Lock "cinder-quobyte-b3467ea4-f8b8-4c13-9270-eeb81bf28031" released by "delete_volume" :: held 1.146s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:52 devstack cinder-volume[87054]: WARNING cinder.quota [None req-6c49de26-bec8-4f7a-8167-29163a2d883c tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:42:52 devstack cinder-volume[87054]: WARNING cinder.quota [None req-6c49de26-bec8-4f7a-8167-29163a2d883c tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:42:52 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-6c49de26-bec8-4f7a-8167-29163a2d883c tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Created reservations ['ff0e6218-cb77-4024-ad53-4f59da530429', '089ba234-2a3b-4d2a-83fa-a71371800631', '0887acde-ec51-4333-9dbf-572b588b3185', '830f97ca-b153-4a5d-9378-a2d17c65b939'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:42:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6c49de26-bec8-4f7a-8167-29163a2d883c tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6c49de26-bec8-4f7a-8167-29163a2d883c tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6c49de26-bec8-4f7a-8167-29163a2d883c tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6c49de26-bec8-4f7a-8167-29163a2d883c tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6c49de26-bec8-4f7a-8167-29163a2d883c tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6c49de26-bec8-4f7a-8167-29163a2d883c tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:53 devstack sudo[101489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:42:53 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:53 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6c49de26-bec8-4f7a-8167-29163a2d883c tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.470s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:53 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6c49de26-bec8-4f7a-8167-29163a2d883c tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:42:53 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-6c49de26-bec8-4f7a-8167-29163a2d883c tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Deleted volume successfully.
Nov 07 02:42:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6c49de26-bec8-4f7a-8167-29163a2d883c tempest-VolumeAndVolumeTypeFromImageTest-1133746381 None] Lock "cinder-b3467ea4-f8b8-4c13-9270-eeb81bf28031-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:55 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d4decf42-a20a-404f-b6c1-5c4558c1d3d7" returned: 0 in 6.808s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:55 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Image conversion details: src /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5, size 1024.00 MB, duration 6.81 sec, destination /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d4decf42-a20a-404f-b6c1-5c4558c1d3d7 {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:42:55 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Converted 1024.00 MB image at 150.40 MB/s
Nov 07 02:42:55 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d4decf42-a20a-404f-b6c1-5c4558c1d3d7 is being set with open permissions: ugo+rw
Nov 07 02:42:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d4decf42-a20a-404f-b6c1-5c4558c1d3d7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:55 devstack sudo[101492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d4decf42-a20a-404f-b6c1-5c4558c1d3d7
Nov 07 02:42:55 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:55 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d4decf42-a20a-404f-b6c1-5c4558c1d3d7" returned: 0 in 0.239s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:55 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-d4decf42-a20a-404f-b6c1-5c4558c1d3d7" released by "_copy_volume_from_snapshot" :: held 8.009s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:55 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-f2a39758-11a9-40e5-a9fa-6180dfe33353-d4decf42-a20a-404f-b6c1-5c4558c1d3d7" released by "_create_volume_from_snapshot" :: held 8.088s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.112s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d2b79651-21db-4d28-b854-0d613800382e tempest-SnapshotsActionsTest-2075701007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.903s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-d2b79651-21db-4d28-b854-0d613800382e tempest-SnapshotsActionsTest-2075701007 None] Creating offline snapshot d87feadf-8d55-406c-9a56-9584bcae9aac of volume 802920cf-74b2-454f-9c77-19bb9b039f87 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:42:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc4ac2e-bf26-4a66-8108-620046db3fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4decf42-a20a-404f-b6c1-5c4558c1d3d7', 'volume_size': 1, 'snapshot_id': 'f2a39758-11a9-40e5-a9fa-6180dfe33353'}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c223946-d27a-451d-9500-3e0507f39eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:55 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[6996f09e-52a2-46a5-8b88-e0cbabe761d8]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d2b79651-21db-4d28-b854-0d613800382e tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:55 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Volume volume-d4decf42-a20a-404f-b6c1-5c4558c1d3d7 (d4decf42-a20a-404f-b6c1-5c4558c1d3d7): created successfully
Nov 07 02:42:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c223946-d27a-451d-9500-3e0507f39eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Flow 'volume_create_manager' (3a88c798-bfa5-49d4-841f-cb5f874b3be4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:55 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f492e663-86fe-474d-8788-f3c6ab3da2b5 tempest-VolumesSnapshotTestJSON-1826004545 None] Created volume successfully.
Nov 07 02:42:55 devstack sudo[101495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932
Nov 07 02:42:55 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:55 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d2b79651-21db-4d28-b854-0d613800382e tempest-SnapshotsActionsTest-2075701007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932" returned: 0 in 0.377s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-d2b79651-21db-4d28-b854-0d613800382e tempest-SnapshotsActionsTest-2075701007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-802920cf-74b2-454f-9c77-19bb9b039f87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:42:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d2b79651-21db-4d28-b854-0d613800382e tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.d87feadf-8d55-406c-9a56-9584bcae9aac 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:55 devstack sudo[101500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.d87feadf-8d55-406c-9a56-9584bcae9aac 1G
Nov 07 02:42:55 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:56 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0b2ea49a-6b45-4eb5-a07e-7b13f5f733c2 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "cinder-d4decf42-a20a-404f-b6c1-5c4558c1d3d7-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:56 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0b2ea49a-6b45-4eb5-a07e-7b13f5f733c2 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-d4decf42-a20a-404f-b6c1-5c4558c1d3d7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:56 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0b2ea49a-6b45-4eb5-a07e-7b13f5f733c2 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "cinder-quobyte-d4decf42-a20a-404f-b6c1-5c4558c1d3d7" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:56 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0b2ea49a-6b45-4eb5-a07e-7b13f5f733c2 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-d4decf42-a20a-404f-b6c1-5c4558c1d3d7" acquired by "delete_volume" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:56 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[043f6c0d-7fcf-4a5f-a7e2-9b2de75b223e]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0b2ea49a-6b45-4eb5-a07e-7b13f5f733c2 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d4decf42-a20a-404f-b6c1-5c4558c1d3d7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:56 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d2b79651-21db-4d28-b854-0d613800382e tempest-SnapshotsActionsTest-2075701007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.d87feadf-8d55-406c-9a56-9584bcae9aac 1G" returned: 0 in 0.579s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d2b79651-21db-4d28-b854-0d613800382e tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.d87feadf-8d55-406c-9a56-9584bcae9aac {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:56 devstack sudo[101507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.d87feadf-8d55-406c-9a56-9584bcae9aac
Nov 07 02:42:56 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:56 devstack sudo[101506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d4decf42-a20a-404f-b6c1-5c4558c1d3d7
Nov 07 02:42:56 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:56 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d2b79651-21db-4d28-b854-0d613800382e tempest-SnapshotsActionsTest-2075701007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.d87feadf-8d55-406c-9a56-9584bcae9aac" returned: 0 in 0.301s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:56 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-d2b79651-21db-4d28-b854-0d613800382e tempest-SnapshotsActionsTest-2075701007 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.d87feadf-8d55-406c-9a56-9584bcae9aac is being set with open permissions: ugo+rw
Nov 07 02:42:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d2b79651-21db-4d28-b854-0d613800382e tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.d87feadf-8d55-406c-9a56-9584bcae9aac {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:56 devstack sudo[101515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.d87feadf-8d55-406c-9a56-9584bcae9aac
Nov 07 02:42:56 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:56 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0b2ea49a-6b45-4eb5-a07e-7b13f5f733c2 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d4decf42-a20a-404f-b6c1-5c4558c1d3d7" returned: 0 in 0.415s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0b2ea49a-6b45-4eb5-a07e-7b13f5f733c2 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d4decf42-a20a-404f-b6c1-5c4558c1d3d7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:56 devstack sudo[101519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d4decf42-a20a-404f-b6c1-5c4558c1d3d7
Nov 07 02:42:56 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:57 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d2b79651-21db-4d28-b854-0d613800382e tempest-SnapshotsActionsTest-2075701007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.d87feadf-8d55-406c-9a56-9584bcae9aac" returned: 0 in 0.295s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d2b79651-21db-4d28-b854-0d613800382e tempest-SnapshotsActionsTest-2075701007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.699s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:57 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-d2b79651-21db-4d28-b854-0d613800382e tempest-SnapshotsActionsTest-2075701007 None] Create snapshot completed successfully
Nov 07 02:42:57 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0b2ea49a-6b45-4eb5-a07e-7b13f5f733c2 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d4decf42-a20a-404f-b6c1-5c4558c1d3d7" returned: 0 in 0.286s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0b2ea49a-6b45-4eb5-a07e-7b13f5f733c2 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-d4decf42-a20a-404f-b6c1-5c4558c1d3d7" released by "delete_volume" :: held 0.753s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-0b2ea49a-6b45-4eb5-a07e-7b13f5f733c2 tempest-VolumesSnapshotTestJSON-1826004545 None] Created reservations ['f400f7c8-4658-41e0-8b64-cb73ddfc3259', 'd7d14901-63c1-4933-a54f-d2ca10bf153c', 'ed2699a3-57d2-4edc-8a23-7dd0f09d26fd', '0f0d6f0d-d7df-4a6a-afb6-d0d49f363861'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0b2ea49a-6b45-4eb5-a07e-7b13f5f733c2 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0b2ea49a-6b45-4eb5-a07e-7b13f5f733c2 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0b2ea49a-6b45-4eb5-a07e-7b13f5f733c2 tempest-VolumesSnapshotTestJSON-1826004545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0b2ea49a-6b45-4eb5-a07e-7b13f5f733c2 tempest-VolumesSnapshotTestJSON-1826004545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0b2ea49a-6b45-4eb5-a07e-7b13f5f733c2 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0b2ea49a-6b45-4eb5-a07e-7b13f5f733c2 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:57 devstack sudo[101523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:42:57 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:57 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0b2ea49a-6b45-4eb5-a07e-7b13f5f733c2 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.248s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-0b2ea49a-6b45-4eb5-a07e-7b13f5f733c2 tempest-VolumesSnapshotTestJSON-1826004545 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:42:57 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-0b2ea49a-6b45-4eb5-a07e-7b13f5f733c2 tempest-VolumesSnapshotTestJSON-1826004545 None] Deleted volume successfully.
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3fdff31f-beaf-43c9-adb2-13ba0f410994 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "cinder-f2a39758-11a9-40e5-a9fa-6180dfe33353-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0b2ea49a-6b45-4eb5-a07e-7b13f5f733c2 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-d4decf42-a20a-404f-b6c1-5c4558c1d3d7-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3fdff31f-beaf-43c9-adb2-13ba0f410994 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-f2a39758-11a9-40e5-a9fa-6180dfe33353-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3fdff31f-beaf-43c9-adb2-13ba0f410994 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "cinder-quobyte-c44357b5-d0bd-4edb-9086-dce2764a49b5" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3fdff31f-beaf-43c9-adb2-13ba0f410994 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-c44357b5-d0bd-4edb-9086-dce2764a49b5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3fdff31f-beaf-43c9-adb2-13ba0f410994 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "cinder-quobyte-f2a39758-11a9-40e5-a9fa-6180dfe33353" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3fdff31f-beaf-43c9-adb2-13ba0f410994 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-f2a39758-11a9-40e5-a9fa-6180dfe33353" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-3fdff31f-beaf-43c9-adb2-13ba0f410994 tempest-VolumesSnapshotTestJSON-1826004545 None] Deleting offline snapshot f2a39758-11a9-40e5-a9fa-6180dfe33353 of volume c44357b5-d0bd-4edb-9086-dce2764a49b5 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-3fdff31f-beaf-43c9-adb2-13ba0f410994 tempest-VolumesSnapshotTestJSON-1826004545 None] snapshot_file for this snap is: volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.f2a39758-11a9-40e5-a9fa-6180dfe33353 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[36728f36-a902-4460-b62e-2b38a4dfd1b5]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3fdff31f-beaf-43c9-adb2-13ba0f410994 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.f2a39758-11a9-40e5-a9fa-6180dfe33353 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:57 devstack sudo[101526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.f2a39758-11a9-40e5-a9fa-6180dfe33353
Nov 07 02:42:57 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:58 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b631a3e9-4a5f-4fa8-a590-30326aaa4cb9 tempest-SnapshotsActionsTest-197122187 None] Acquiring lock "cinder-d87feadf-8d55-406c-9a56-9584bcae9aac-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:58 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3fdff31f-beaf-43c9-adb2-13ba0f410994 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.f2a39758-11a9-40e5-a9fa-6180dfe33353" returned: 0 in 0.403s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:58 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b631a3e9-4a5f-4fa8-a590-30326aaa4cb9 tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-d87feadf-8d55-406c-9a56-9584bcae9aac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:58 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b631a3e9-4a5f-4fa8-a590-30326aaa4cb9 tempest-SnapshotsActionsTest-197122187 None] Acquiring lock "cinder-quobyte-802920cf-74b2-454f-9c77-19bb9b039f87" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:58 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-3fdff31f-beaf-43c9-adb2-13ba0f410994 tempest-VolumesSnapshotTestJSON-1826004545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c44357b5-d0bd-4edb-9086-dce2764a49b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:42:58 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b631a3e9-4a5f-4fa8-a590-30326aaa4cb9 tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-quobyte-802920cf-74b2-454f-9c77-19bb9b039f87" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:58 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b631a3e9-4a5f-4fa8-a590-30326aaa4cb9 tempest-SnapshotsActionsTest-197122187 None] Acquiring lock "cinder-quobyte-d87feadf-8d55-406c-9a56-9584bcae9aac" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:58 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[875ae203-facc-458d-9b16-9f2419e1f3e8]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3fdff31f-beaf-43c9-adb2-13ba0f410994 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:58 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b631a3e9-4a5f-4fa8-a590-30326aaa4cb9 tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-quobyte-d87feadf-8d55-406c-9a56-9584bcae9aac" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:58 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-b631a3e9-4a5f-4fa8-a590-30326aaa4cb9 tempest-SnapshotsActionsTest-197122187 None] Deleting offline snapshot d87feadf-8d55-406c-9a56-9584bcae9aac of volume 802920cf-74b2-454f-9c77-19bb9b039f87 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:42:58 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-b631a3e9-4a5f-4fa8-a590-30326aaa4cb9 tempest-SnapshotsActionsTest-197122187 None] snapshot_file for this snap is: volume-802920cf-74b2-454f-9c77-19bb9b039f87.d87feadf-8d55-406c-9a56-9584bcae9aac {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:42:58 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ed2608-2ec9-459b-aa65-62563a8b1ef2]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b631a3e9-4a5f-4fa8-a590-30326aaa4cb9 tempest-SnapshotsActionsTest-197122187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.d87feadf-8d55-406c-9a56-9584bcae9aac {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:58 devstack sudo[101532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5
Nov 07 02:42:58 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:58 devstack sudo[101533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.d87feadf-8d55-406c-9a56-9584bcae9aac
Nov 07 02:42:58 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:58 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b631a3e9-4a5f-4fa8-a590-30326aaa4cb9 tempest-SnapshotsActionsTest-197122187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.d87feadf-8d55-406c-9a56-9584bcae9aac" returned: 0 in 0.404s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:58 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-b631a3e9-4a5f-4fa8-a590-30326aaa4cb9 tempest-SnapshotsActionsTest-197122187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-802920cf-74b2-454f-9c77-19bb9b039f87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:42:58 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31d50fe-d6da-4677-b988-3683051969ef]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:42:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b631a3e9-4a5f-4fa8-a590-30326aaa4cb9 tempest-SnapshotsActionsTest-197122187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:58 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3fdff31f-beaf-43c9-adb2-13ba0f410994 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5" returned: 0 in 0.589s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3fdff31f-beaf-43c9-adb2-13ba0f410994 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.f2a39758-11a9-40e5-a9fa-6180dfe33353 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:58 devstack sudo[101544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.f2a39758-11a9-40e5-a9fa-6180dfe33353
Nov 07 02:42:58 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:58 devstack sudo[101543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932
Nov 07 02:42:58 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Flow 'volume_create_manager' (2f558a2d-98d6-41eb-a483-3a7807910a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b40eaaf3-35af-4c89-a21c-83128e70845e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:59 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b40eaaf3-35af-4c89-a21c-83128e70845e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-31564299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ff49fa-8dba-436a-bfce-3658f81cebbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b3f354ecfb4824bacc032471d03155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:42:59Z,use_quota=True,user_id='12d51a2090f34fa2a831e1ceede74ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394cd261-a571-441b-ba36-67002aa7a54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394cd261-a571-441b-ba36-67002aa7a54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c802de74-c59a-47ac-9138-fdff3303122f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c802de74-c59a-47ac-9138-fdff3303122f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29ff49fa-8dba-436a-bfce-3658f81cebbe', 'volume_name': 'volume-29ff49fa-8dba-436a-bfce-3658f81cebbe', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b4cd4d0-2694-4518-879f-366a7813b9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b4cd4d0-2694-4518-879f-366a7813b9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616cb482-087e-44d2-8be7-cee55cbb33af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:42:59 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Volume 29ff49fa-8dba-436a-bfce-3658f81cebbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29ff49fa-8dba-436a-bfce-3658f81cebbe', 'volume_size': 1}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:59 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-31564299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ff49fa-8dba-436a-bfce-3658f81cebbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b3f354ecfb4824bacc032471d03155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:42:59Z,use_quota=True,user_id='12d51a2090f34fa2a831e1ceede74ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Creating volume 29ff49fa-8dba-436a-bfce-3658f81cebbe {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:42:59 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:59 devstack sudo[101554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe 1073741824
Nov 07 02:42:59 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b631a3e9-4a5f-4fa8-a590-30326aaa4cb9 tempest-SnapshotsActionsTest-197122187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932" returned: 0 in 0.482s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-b631a3e9-4a5f-4fa8-a590-30326aaa4cb9 tempest-SnapshotsActionsTest-197122187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-802920cf-74b2-454f-9c77-19bb9b039f87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b631a3e9-4a5f-4fa8-a590-30326aaa4cb9 tempest-SnapshotsActionsTest-197122187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.d87feadf-8d55-406c-9a56-9584bcae9aac {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:59 devstack sudo[101555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:42:59 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3fdff31f-beaf-43c9-adb2-13ba0f410994 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.f2a39758-11a9-40e5-a9fa-6180dfe33353" returned: 0 in 0.449s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3fdff31f-beaf-43c9-adb2-13ba0f410994 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.f2a39758-11a9-40e5-a9fa-6180dfe33353 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:59 devstack sudo[101557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.d87feadf-8d55-406c-9a56-9584bcae9aac
Nov 07 02:42:59 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:59 devstack sudo[101559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.f2a39758-11a9-40e5-a9fa-6180dfe33353
Nov 07 02:42:59 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:59 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.261s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 28 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>, <Thread(fd_logger, started daemon 125443282798592)>, <Thread(privsep_reader, started daemon 125443284556288)>, <Thread(tpool_thread_0, started daemon 125443276445376)>, <Thread(tpool_thread_1, started daemon 125443268036288)>, <Thread(tpool_thread_2, started daemon 125443259627200)>, <Thread(tpool_thread_3, started daemon 125443251218112)>, <Thread(tpool_thread_4, started daemon 125443242809024)>, <Thread(tpool_thread_5, started daemon 125443234399936)>, <Thread(tpool_thread_6, started daemon 125443225990848)>, <Thread(tpool_thread_7, started daemon 125443217581760)>, <Thread(tpool_thread_8, started daemon 125443209172672)>, <Thread(tpool_thread_9, started daemon 125443200763584)>, <Thread(tpool_thread_10, started daemon 125443192354496)>, <Thread(tpool_thread_11, started daemon 125443183945408)>, <Thread(tpool_thread_12, started daemon 125443175536320)>, <Thread(tpool_thread_13, started daemon 125443167127232)>, <Thread(tpool_thread_14, started daemon 125443158718144)>, <Thread(tpool_thread_15, started daemon 125443150309056)>, <Thread(tpool_thread_16, started daemon 125443141899968)>, <Thread(tpool_thread_17, started daemon 125443133490880)>, <Thread(tpool_thread_18, started daemon 125443125081792)>, <Thread(tpool_thread_19, started daemon 125443116672704)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:42:59 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3fdff31f-beaf-43c9-adb2-13ba0f410994 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5.f2a39758-11a9-40e5-a9fa-6180dfe33353" returned: 0 in 0.273s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3fdff31f-beaf-43c9-adb2-13ba0f410994 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-f2a39758-11a9-40e5-a9fa-6180dfe33353" released by "_delete_snapshot" :: held 1.843s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3fdff31f-beaf-43c9-adb2-13ba0f410994 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-c44357b5-d0bd-4edb-9086-dce2764a49b5" released by "delete_snapshot" :: held 1.863s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-3fdff31f-beaf-43c9-adb2-13ba0f410994 tempest-VolumesSnapshotTestJSON-1826004545 None] Created reservations ['b8c45548-0534-4a8b-befc-4a0d96c00f27', '9870dbce-5f9e-48c4-948f-6103be90ef39', '79ca0a06-7f54-4fec-aed5-9fc116c5bad7', 'a46f327e-1814-4ab3-8dad-b597346caf0b'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:42:59 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b631a3e9-4a5f-4fa8-a590-30326aaa4cb9 tempest-SnapshotsActionsTest-197122187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.d87feadf-8d55-406c-9a56-9584bcae9aac" returned: 0 in 0.423s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b631a3e9-4a5f-4fa8-a590-30326aaa4cb9 tempest-SnapshotsActionsTest-197122187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.d87feadf-8d55-406c-9a56-9584bcae9aac {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:59 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:59 devstack sudo[101572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.d87feadf-8d55-406c-9a56-9584bcae9aac
Nov 07 02:42:59 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe 1073741824" returned: 0 in 0.496s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:59 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-3fdff31f-beaf-43c9-adb2-13ba0f410994 tempest-VolumesSnapshotTestJSON-1826004545 None] Delete snapshot completed successfully.
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3fdff31f-beaf-43c9-adb2-13ba0f410994 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-f2a39758-11a9-40e5-a9fa-6180dfe33353-delete_snapshot" released by "delete_snapshot" :: held 2.042s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:42:59 devstack sudo[101574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe
Nov 07 02:42:59 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:42:59 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-fddea1f5-1140-48aa-a575-312b83190b53 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "cinder-c44357b5-d0bd-4edb-9086-dce2764a49b5-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b631a3e9-4a5f-4fa8-a590-30326aaa4cb9 tempest-SnapshotsActionsTest-197122187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.d87feadf-8d55-406c-9a56-9584bcae9aac" returned: 0 in 0.263s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b631a3e9-4a5f-4fa8-a590-30326aaa4cb9 tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-quobyte-d87feadf-8d55-406c-9a56-9584bcae9aac" released by "_delete_snapshot" :: held 1.733s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:42:59 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-fddea1f5-1140-48aa-a575-312b83190b53 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-c44357b5-d0bd-4edb-9086-dce2764a49b5-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe" returned: 0 in 0.301s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:42:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b631a3e9-4a5f-4fa8-a590-30326aaa4cb9 tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-quobyte-802920cf-74b2-454f-9c77-19bb9b039f87" released by "delete_snapshot" :: held 1.839s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616cb482-087e-44d2-8be7-cee55cbb33af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29ff49fa-8dba-436a-bfce-3658f81cebbe', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29cd595-3e79-453a-9987-467a118de2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:00 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Volume volume-29ff49fa-8dba-436a-bfce-3658f81cebbe (29ff49fa-8dba-436a-bfce-3658f81cebbe): created successfully
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29cd595-3e79-453a-9987-467a118de2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Flow 'volume_create_manager' (2f558a2d-98d6-41eb-a483-3a7807910a5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:00 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-256c3e41-b621-41d3-ba5f-6d63e4262f72 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Created volume successfully.
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-fddea1f5-1140-48aa-a575-312b83190b53 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "cinder-quobyte-c44357b5-d0bd-4edb-9086-dce2764a49b5" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-fddea1f5-1140-48aa-a575-312b83190b53 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-c44357b5-d0bd-4edb-9086-dce2764a49b5" acquired by "delete_volume" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-b631a3e9-4a5f-4fa8-a590-30326aaa4cb9 tempest-SnapshotsActionsTest-197122187 None] Created reservations ['c25fd636-e0d5-46b0-98f9-66cb7e471814', '071be42a-4209-4f47-8645-7b171f117d0e', 'f738a1f3-d4a3-4584-95e9-0fc40484866a', '6735e52b-349e-42bd-9549-096d1a563463'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfd6d46-f6f3-4ce5-881f-052f0008e19b]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fddea1f5-1140-48aa-a575-312b83190b53 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:00 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b631a3e9-4a5f-4fa8-a590-30326aaa4cb9 tempest-SnapshotsActionsTest-197122187 None] Delete snapshot completed successfully.
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b631a3e9-4a5f-4fa8-a590-30326aaa4cb9 tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-d87feadf-8d55-406c-9a56-9584bcae9aac-delete_snapshot" released by "delete_snapshot" :: held 2.088s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:00 devstack sudo[101578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5
Nov 07 02:43:00 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:00 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fddea1f5-1140-48aa-a575-312b83190b53 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5" returned: 0 in 0.367s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fddea1f5-1140-48aa-a575-312b83190b53 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:00 devstack sudo[101584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5
Nov 07 02:43:00 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-08f2a266-6654-476e-bbd7-31a33af9b640 tempest-SnapshotsActionsTest-2075701007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-08f2a266-6654-476e-bbd7-31a33af9b640 tempest-SnapshotsActionsTest-2075701007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-08f2a266-6654-476e-bbd7-31a33af9b640 tempest-SnapshotsActionsTest-2075701007 None] Creating offline snapshot 1604b850-d959-4cb3-a9f4-af0dd6c889a4 of volume 802920cf-74b2-454f-9c77-19bb9b039f87 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7af942-b804-4f8e-82bd-af2d7ebdd9cb]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-08f2a266-6654-476e-bbd7-31a33af9b640 tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:00 devstack sudo[101586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932
Nov 07 02:43:00 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:00 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fddea1f5-1140-48aa-a575-312b83190b53 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c44357b5-d0bd-4edb-9086-dce2764a49b5" returned: 0 in 0.254s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-fddea1f5-1140-48aa-a575-312b83190b53 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-c44357b5-d0bd-4edb-9086-dce2764a49b5" released by "delete_volume" :: held 0.684s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-fddea1f5-1140-48aa-a575-312b83190b53 tempest-VolumesSnapshotTestJSON-1826004545 None] Created reservations ['fdea2398-23a5-4687-9c14-bcc42668ab4c', '11c50e3d-43b3-44e0-9dfd-1bb673316832', '27d50813-8fc3-4cad-93a6-cb3c5c03413c', 'f924ea14-1f40-4f44-8197-5fad4654efd3'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-fddea1f5-1140-48aa-a575-312b83190b53 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-fddea1f5-1140-48aa-a575-312b83190b53 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-fddea1f5-1140-48aa-a575-312b83190b53 tempest-VolumesSnapshotTestJSON-1826004545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-fddea1f5-1140-48aa-a575-312b83190b53 tempest-VolumesSnapshotTestJSON-1826004545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-fddea1f5-1140-48aa-a575-312b83190b53 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fddea1f5-1140-48aa-a575-312b83190b53 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:00 devstack sudo[101589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:43:00 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:01 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-08f2a266-6654-476e-bbd7-31a33af9b640 tempest-SnapshotsActionsTest-2075701007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932" returned: 0 in 0.389s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:01 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-08f2a266-6654-476e-bbd7-31a33af9b640 tempest-SnapshotsActionsTest-2075701007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-802920cf-74b2-454f-9c77-19bb9b039f87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:43:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-08f2a266-6654-476e-bbd7-31a33af9b640 tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.1604b850-d959-4cb3-a9f4-af0dd6c889a4 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:01 devstack sudo[101594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.1604b850-d959-4cb3-a9f4-af0dd6c889a4 1G
Nov 07 02:43:01 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f13edd55-36fa-4579-80b7-17486af09236 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "cinder-321c9e40-12ea-4630-bd23-8cfa7d5ac049-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:01 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f13edd55-36fa-4579-80b7-17486af09236 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-321c9e40-12ea-4630-bd23-8cfa7d5ac049-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fddea1f5-1140-48aa-a575-312b83190b53 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.289s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:01 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-fddea1f5-1140-48aa-a575-312b83190b53 tempest-VolumesSnapshotTestJSON-1826004545 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:01 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-fddea1f5-1140-48aa-a575-312b83190b53 tempest-VolumesSnapshotTestJSON-1826004545 None] Deleted volume successfully.
Nov 07 02:43:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f13edd55-36fa-4579-80b7-17486af09236 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "cinder-quobyte-321c9e40-12ea-4630-bd23-8cfa7d5ac049" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-fddea1f5-1140-48aa-a575-312b83190b53 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-c44357b5-d0bd-4edb-9086-dce2764a49b5-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f13edd55-36fa-4579-80b7-17486af09236 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-321c9e40-12ea-4630-bd23-8cfa7d5ac049" acquired by "delete_volume" :: waited 0.019s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:01 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85bb197-4b25-47c5-9575-41d628a3ebb5]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f13edd55-36fa-4579-80b7-17486af09236 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-4c3acf99-4d11-4b81-a78f-cb7884855ae8 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:01 devstack sudo[101633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049
Nov 07 02:43:01 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:01 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-08f2a266-6654-476e-bbd7-31a33af9b640 tempest-SnapshotsActionsTest-2075701007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.1604b850-d959-4cb3-a9f4-af0dd6c889a4 1G" returned: 0 in 0.579s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-08f2a266-6654-476e-bbd7-31a33af9b640 tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.1604b850-d959-4cb3-a9f4-af0dd6c889a4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:01 devstack sudo[101639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.1604b850-d959-4cb3-a9f4-af0dd6c889a4
Nov 07 02:43:01 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:01 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f13edd55-36fa-4579-80b7-17486af09236 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049" returned: 0 in 0.430s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f13edd55-36fa-4579-80b7-17486af09236 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:01 devstack sudo[101644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049
Nov 07 02:43:01 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:01 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-08f2a266-6654-476e-bbd7-31a33af9b640 tempest-SnapshotsActionsTest-2075701007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.1604b850-d959-4cb3-a9f4-af0dd6c889a4" returned: 0 in 0.295s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:01 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-08f2a266-6654-476e-bbd7-31a33af9b640 tempest-SnapshotsActionsTest-2075701007 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.1604b850-d959-4cb3-a9f4-af0dd6c889a4 is being set with open permissions: ugo+rw
Nov 07 02:43:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-08f2a266-6654-476e-bbd7-31a33af9b640 tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.1604b850-d959-4cb3-a9f4-af0dd6c889a4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:01 devstack sudo[101649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.1604b850-d959-4cb3-a9f4-af0dd6c889a4
Nov 07 02:43:01 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:02 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f13edd55-36fa-4579-80b7-17486af09236 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-321c9e40-12ea-4630-bd23-8cfa7d5ac049" returned: 0 in 0.251s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f13edd55-36fa-4579-80b7-17486af09236 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-quobyte-321c9e40-12ea-4630-bd23-8cfa7d5ac049" released by "delete_volume" :: held 0.775s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-f13edd55-36fa-4579-80b7-17486af09236 tempest-VolumesSnapshotTestJSON-1826004545 None] Created reservations ['bc89a1b7-c1bf-4320-8eb5-4fc980d53bce', '18925bac-5ffe-4a98-bb68-f1dd70586dc5', '6cf2ebc3-088f-44c8-ab1f-a512999e66a2', '41279345-26d9-41ea-84e6-96a598f2fb11'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:02 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f13edd55-36fa-4579-80b7-17486af09236 tempest-VolumesSnapshotTestJSON-1826004545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f13edd55-36fa-4579-80b7-17486af09236 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f13edd55-36fa-4579-80b7-17486af09236 tempest-VolumesSnapshotTestJSON-1826004545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f13edd55-36fa-4579-80b7-17486af09236 tempest-VolumesSnapshotTestJSON-1826004545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f13edd55-36fa-4579-80b7-17486af09236 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f13edd55-36fa-4579-80b7-17486af09236 tempest-VolumesSnapshotTestJSON-1826004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-08f2a266-6654-476e-bbd7-31a33af9b640 tempest-SnapshotsActionsTest-2075701007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.1604b850-d959-4cb3-a9f4-af0dd6c889a4" returned: 0 in 0.278s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:02 devstack sudo[101653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:43:02 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-08f2a266-6654-476e-bbd7-31a33af9b640 tempest-SnapshotsActionsTest-2075701007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.651s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-4c3acf99-4d11-4b81-a78f-cb7884855ae8 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.814s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-4c3acf99-4d11-4b81-a78f-cb7884855ae8 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Creating offline snapshot 65a53fa6-2aa5-4b0b-8c04-6de9a965cc31 of volume 29ff49fa-8dba-436a-bfce-3658f81cebbe {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:43:02 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-08f2a266-6654-476e-bbd7-31a33af9b640 tempest-SnapshotsActionsTest-2075701007 None] Create snapshot completed successfully
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d004ff3-6c4a-432f-9662-2f0de1e0124a]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4c3acf99-4d11-4b81-a78f-cb7884855ae8 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:02 devstack sudo[101655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe
Nov 07 02:43:02 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:02 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f13edd55-36fa-4579-80b7-17486af09236 tempest-VolumesSnapshotTestJSON-1826004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.288s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-f13edd55-36fa-4579-80b7-17486af09236 tempest-VolumesSnapshotTestJSON-1826004545 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:02 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f13edd55-36fa-4579-80b7-17486af09236 tempest-VolumesSnapshotTestJSON-1826004545 None] Deleted volume successfully.
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f13edd55-36fa-4579-80b7-17486af09236 tempest-VolumesSnapshotTestJSON-1826004545 None] Lock "cinder-321c9e40-12ea-4630-bd23-8cfa7d5ac049-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:02 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4c3acf99-4d11-4b81-a78f-cb7884855ae8 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe" returned: 0 in 0.432s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4c3acf99-4d11-4b81-a78f-cb7884855ae8 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.65a53fa6-2aa5-4b0b-8c04-6de9a965cc31 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:02 devstack sudo[101662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.65a53fa6-2aa5-4b0b-8c04-6de9a965cc31 1G
Nov 07 02:43:02 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0b2f8f16-8944-4cef-bf46-77bbc9809cbb tempest-SnapshotsActionsTest-197122187 None] Acquiring lock "cinder-1604b850-d959-4cb3-a9f4-af0dd6c889a4-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0b2f8f16-8944-4cef-bf46-77bbc9809cbb tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-1604b850-d959-4cb3-a9f4-af0dd6c889a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0b2f8f16-8944-4cef-bf46-77bbc9809cbb tempest-SnapshotsActionsTest-197122187 None] Acquiring lock "cinder-quobyte-802920cf-74b2-454f-9c77-19bb9b039f87" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0b2f8f16-8944-4cef-bf46-77bbc9809cbb tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-quobyte-802920cf-74b2-454f-9c77-19bb9b039f87" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0b2f8f16-8944-4cef-bf46-77bbc9809cbb tempest-SnapshotsActionsTest-197122187 None] Acquiring lock "cinder-quobyte-1604b850-d959-4cb3-a9f4-af0dd6c889a4" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0b2f8f16-8944-4cef-bf46-77bbc9809cbb tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-quobyte-1604b850-d959-4cb3-a9f4-af0dd6c889a4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-0b2f8f16-8944-4cef-bf46-77bbc9809cbb tempest-SnapshotsActionsTest-197122187 None] Deleting offline snapshot 1604b850-d959-4cb3-a9f4-af0dd6c889a4 of volume 802920cf-74b2-454f-9c77-19bb9b039f87 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-0b2f8f16-8944-4cef-bf46-77bbc9809cbb tempest-SnapshotsActionsTest-197122187 None] snapshot_file for this snap is: volume-802920cf-74b2-454f-9c77-19bb9b039f87.1604b850-d959-4cb3-a9f4-af0dd6c889a4 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc37a2c-0469-4146-b821-daa90defccd7]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0b2f8f16-8944-4cef-bf46-77bbc9809cbb tempest-SnapshotsActionsTest-197122187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.1604b850-d959-4cb3-a9f4-af0dd6c889a4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:03 devstack sudo[101664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.1604b850-d959-4cb3-a9f4-af0dd6c889a4
Nov 07 02:43:03 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:03 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4c3acf99-4d11-4b81-a78f-cb7884855ae8 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.65a53fa6-2aa5-4b0b-8c04-6de9a965cc31 1G" returned: 0 in 0.529s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4c3acf99-4d11-4b81-a78f-cb7884855ae8 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29ff49fa-8dba-436a-bfce-3658f81cebbe -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.65a53fa6-2aa5-4b0b-8c04-6de9a965cc31 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:03 devstack sudo[101670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29ff49fa-8dba-436a-bfce-3658f81cebbe -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.65a53fa6-2aa5-4b0b-8c04-6de9a965cc31
Nov 07 02:43:03 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:03 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0b2f8f16-8944-4cef-bf46-77bbc9809cbb tempest-SnapshotsActionsTest-197122187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.1604b850-d959-4cb3-a9f4-af0dd6c889a4" returned: 0 in 0.454s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-0b2f8f16-8944-4cef-bf46-77bbc9809cbb tempest-SnapshotsActionsTest-197122187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-802920cf-74b2-454f-9c77-19bb9b039f87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:43:03 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[58873849-3d9b-4e04-9fc7-d40c7f42fa5d]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0b2f8f16-8944-4cef-bf46-77bbc9809cbb tempest-SnapshotsActionsTest-197122187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:03 devstack sudo[101675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932
Nov 07 02:43:03 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:03 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4c3acf99-4d11-4b81-a78f-cb7884855ae8 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29ff49fa-8dba-436a-bfce-3658f81cebbe -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.65a53fa6-2aa5-4b0b-8c04-6de9a965cc31" returned: 0 in 0.334s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:03 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-4c3acf99-4d11-4b81-a78f-cb7884855ae8 tempest-CreateVolumesFromSnapshotTest-1428766699 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.65a53fa6-2aa5-4b0b-8c04-6de9a965cc31 is being set with open permissions: ugo+rw
Nov 07 02:43:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4c3acf99-4d11-4b81-a78f-cb7884855ae8 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.65a53fa6-2aa5-4b0b-8c04-6de9a965cc31 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:03 devstack sudo[101681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.65a53fa6-2aa5-4b0b-8c04-6de9a965cc31
Nov 07 02:43:03 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:03 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0b2f8f16-8944-4cef-bf46-77bbc9809cbb tempest-SnapshotsActionsTest-197122187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932" returned: 0 in 0.389s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-0b2f8f16-8944-4cef-bf46-77bbc9809cbb tempest-SnapshotsActionsTest-197122187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-802920cf-74b2-454f-9c77-19bb9b039f87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:43:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0b2f8f16-8944-4cef-bf46-77bbc9809cbb tempest-SnapshotsActionsTest-197122187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.1604b850-d959-4cb3-a9f4-af0dd6c889a4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:03 devstack sudo[101689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.1604b850-d959-4cb3-a9f4-af0dd6c889a4
Nov 07 02:43:03 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:03 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4c3acf99-4d11-4b81-a78f-cb7884855ae8 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.65a53fa6-2aa5-4b0b-8c04-6de9a965cc31" returned: 0 in 0.301s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4c3acf99-4d11-4b81-a78f-cb7884855ae8 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:03 devstack sudo[101691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.info
Nov 07 02:43:03 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:04 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4c3acf99-4d11-4b81-a78f-cb7884855ae8 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.info" returned: 0 in 0.280s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:04 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-4c3acf99-4d11-4b81-a78f-cb7884855ae8 tempest-CreateVolumesFromSnapshotTest-1428766699 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.info is being set with open permissions: ugo+rw
Nov 07 02:43:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4c3acf99-4d11-4b81-a78f-cb7884855ae8 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:04 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0b2f8f16-8944-4cef-bf46-77bbc9809cbb tempest-SnapshotsActionsTest-197122187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.1604b850-d959-4cb3-a9f4-af0dd6c889a4" returned: 0 in 0.435s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0b2f8f16-8944-4cef-bf46-77bbc9809cbb tempest-SnapshotsActionsTest-197122187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.1604b850-d959-4cb3-a9f4-af0dd6c889a4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:04 devstack sudo[101698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.info
Nov 07 02:43:04 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:04 devstack sudo[101699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.1604b850-d959-4cb3-a9f4-af0dd6c889a4
Nov 07 02:43:04 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:04 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4c3acf99-4d11-4b81-a78f-cb7884855ae8 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.info" returned: 0 in 0.278s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:04 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-4c3acf99-4d11-4b81-a78f-cb7884855ae8 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.285s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0b2f8f16-8944-4cef-bf46-77bbc9809cbb tempest-SnapshotsActionsTest-197122187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.1604b850-d959-4cb3-a9f4-af0dd6c889a4" returned: 0 in 0.281s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0b2f8f16-8944-4cef-bf46-77bbc9809cbb tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-quobyte-1604b850-d959-4cb3-a9f4-af0dd6c889a4" released by "_delete_snapshot" :: held 1.668s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0b2f8f16-8944-4cef-bf46-77bbc9809cbb tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-quobyte-802920cf-74b2-454f-9c77-19bb9b039f87" released by "delete_snapshot" :: held 1.709s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:04 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-4c3acf99-4d11-4b81-a78f-cb7884855ae8 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Create snapshot completed successfully
Nov 07 02:43:04 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-0b2f8f16-8944-4cef-bf46-77bbc9809cbb tempest-SnapshotsActionsTest-197122187 None] Created reservations ['04b37182-49b1-436e-8dec-40be14792379', '492e2c46-f9ed-439f-90a0-13ce7e53a5fd', '165bf2a3-21d2-4d04-b89a-442f8a1cb66d', '725168f6-eddd-4817-8042-c4beb73c6d86'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:04 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-0b2f8f16-8944-4cef-bf46-77bbc9809cbb tempest-SnapshotsActionsTest-197122187 None] Delete snapshot completed successfully.
Nov 07 02:43:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0b2f8f16-8944-4cef-bf46-77bbc9809cbb tempest-SnapshotsActionsTest-197122187 None] Lock "cinder-1604b850-d959-4cb3-a9f4-af0dd6c889a4-delete_snapshot" released by "delete_snapshot" :: held 1.859s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-45404d6b-d962-4f6c-8e20-15158ec8818e tempest-SnapshotsActionsTest-2075701007 None] Acquiring lock "cinder-175c3bdd-eeae-4e39-9d34-bd10c2fec932-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-45404d6b-d962-4f6c-8e20-15158ec8818e tempest-SnapshotsActionsTest-2075701007 None] Lock "cinder-175c3bdd-eeae-4e39-9d34-bd10c2fec932-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-45404d6b-d962-4f6c-8e20-15158ec8818e tempest-SnapshotsActionsTest-2075701007 None] Acquiring lock "cinder-quobyte-802920cf-74b2-454f-9c77-19bb9b039f87" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-45404d6b-d962-4f6c-8e20-15158ec8818e tempest-SnapshotsActionsTest-2075701007 None] Lock "cinder-quobyte-802920cf-74b2-454f-9c77-19bb9b039f87" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-45404d6b-d962-4f6c-8e20-15158ec8818e tempest-SnapshotsActionsTest-2075701007 None] Acquiring lock "cinder-quobyte-175c3bdd-eeae-4e39-9d34-bd10c2fec932" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-45404d6b-d962-4f6c-8e20-15158ec8818e tempest-SnapshotsActionsTest-2075701007 None] Lock "cinder-quobyte-175c3bdd-eeae-4e39-9d34-bd10c2fec932" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-45404d6b-d962-4f6c-8e20-15158ec8818e tempest-SnapshotsActionsTest-2075701007 None] Deleting offline snapshot 175c3bdd-eeae-4e39-9d34-bd10c2fec932 of volume 802920cf-74b2-454f-9c77-19bb9b039f87 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:43:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-45404d6b-d962-4f6c-8e20-15158ec8818e tempest-SnapshotsActionsTest-2075701007 None] snapshot_file for this snap is: volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:43:05 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10ff008-541a-48a6-b003-5c10d4e88d3f]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-45404d6b-d962-4f6c-8e20-15158ec8818e tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:05 devstack sudo[101704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932
Nov 07 02:43:05 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:06 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-45404d6b-d962-4f6c-8e20-15158ec8818e tempest-SnapshotsActionsTest-2075701007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932" returned: 0 in 0.518s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-45404d6b-d962-4f6c-8e20-15158ec8818e tempest-SnapshotsActionsTest-2075701007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-802920cf-74b2-454f-9c77-19bb9b039f87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c52840-01f8-4c9f-a0e8-21f4a992ddaa]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-45404d6b-d962-4f6c-8e20-15158ec8818e tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Flow 'volume_create_manager' (5e3fe801-cc23-443c-8418-78d128714ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd187eac-12c9-4b93-8c80-829e2b4a00f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd187eac-12c9-4b93-8c80-829e2b4a00f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-429439471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b354ab16-3b6b-4c88-b0a5-64ed52fd95d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b3f354ecfb4824bacc032471d03155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:06Z,use_quota=True,user_id='12d51a2090f34fa2a831e1ceede74ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6da95e6-7bce-4f6a-a9b3-dbb230d8c6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6da95e6-7bce-4f6a-a9b3-dbb230d8c6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a386e3-02cb-4b67-9c2d-c137bbbdbc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:06 devstack sudo[101709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87
Nov 07 02:43:06 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a386e3-02cb-4b67-9c2d-c137bbbdbc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b354ab16-3b6b-4c88-b0a5-64ed52fd95d9', 'volume_name': 'volume-b354ab16-3b6b-4c88-b0a5-64ed52fd95d9', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (456af09e-204e-4fe1-93d9-31d528c6af4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (456af09e-204e-4fe1-93d9-31d528c6af4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f213fb-ed7b-4602-abc9-87bd93da678c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:06 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Volume b354ab16-3b6b-4c88-b0a5-64ed52fd95d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b354ab16-3b6b-4c88-b0a5-64ed52fd95d9', 'volume_size': 1}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-429439471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b354ab16-3b6b-4c88-b0a5-64ed52fd95d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b3f354ecfb4824bacc032471d03155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:06Z,use_quota=True,user_id='12d51a2090f34fa2a831e1ceede74ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Creating volume b354ab16-3b6b-4c88-b0a5-64ed52fd95d9 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:43:06 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b354ab16-3b6b-4c88-b0a5-64ed52fd95d9 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:06 devstack sudo[101711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b354ab16-3b6b-4c88-b0a5-64ed52fd95d9 1073741824
Nov 07 02:43:06 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:06 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-45404d6b-d962-4f6c-8e20-15158ec8818e tempest-SnapshotsActionsTest-2075701007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87" returned: 0 in 0.523s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-45404d6b-d962-4f6c-8e20-15158ec8818e tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:06 devstack sudo[101720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932
Nov 07 02:43:06 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Flow 'volume_create_manager' (c8b9f45c-de13-4e29-a4bf-5810748033bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4222632a-34fc-4c06-87a8-5cc0d835cb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4222632a-34fc-4c06-87a8-5cc0d835cb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1622020611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17492bc2-8f7f-4677-ab64-5bcb0d891b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b3f354ecfb4824bacc032471d03155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:07Z,use_quota=True,user_id='12d51a2090f34fa2a831e1ceede74ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc6ef7d-49c7-4f06-83e7-4f42006e1212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc6ef7d-49c7-4f06-83e7-4f42006e1212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce4543cc-0d67-4674-895d-94e60151d4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce4543cc-0d67-4674-895d-94e60151d4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17492bc2-8f7f-4677-ab64-5bcb0d891b74', 'volume_name': 'volume-17492bc2-8f7f-4677-ab64-5bcb0d891b74', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c416350-e7ef-42c3-a6d8-6eee5f1af851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:06 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c416350-e7ef-42c3-a6d8-6eee5f1af851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5c76f6-d162-4b96-8876-1cafdf65fa0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:06 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Volume 17492bc2-8f7f-4677-ab64-5bcb0d891b74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17492bc2-8f7f-4677-ab64-5bcb0d891b74', 'volume_size': 1}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b354ab16-3b6b-4c88-b0a5-64ed52fd95d9 1073741824" returned: 0 in 0.659s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b354ab16-3b6b-4c88-b0a5-64ed52fd95d9 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:07 devstack sudo[101726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b354ab16-3b6b-4c88-b0a5-64ed52fd95d9
Nov 07 02:43:07 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:07 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-45404d6b-d962-4f6c-8e20-15158ec8818e tempest-SnapshotsActionsTest-2075701007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932" returned: 0 in 0.653s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-45404d6b-d962-4f6c-8e20-15158ec8818e tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:43:07 devstack sudo[101729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932
Nov 07 02:43:07 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Flow 'volume_create_manager' (dcda56c5-6a76-44b2-b86b-e0edff8d421f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c5a420-afef-4a32-abfe-4b1c3e864505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c5a420-afef-4a32-abfe-4b1c3e864505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-713996369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd67ce56-e001-4593-85c9-da18d823c5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b3f354ecfb4824bacc032471d03155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:07Z,use_quota=True,user_id='12d51a2090f34fa2a831e1ceede74ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff80430-90a7-408d-bda8-3a745fcf28cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:07 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff80430-90a7-408d-bda8-3a745fcf28cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2338cf8f-6242-469e-a28d-d3097cc80ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2338cf8f-6242-469e-a28d-d3097cc80ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd67ce56-e001-4593-85c9-da18d823c5af', 'volume_name': 'volume-dd67ce56-e001-4593-85c9-da18d823c5af', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2bccf28-ea56-4540-8b32-a6e08e5b07fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2bccf28-ea56-4540-8b32-a6e08e5b07fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1324cc63-bc74-43b5-942e-5531cb338f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:07 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Volume dd67ce56-e001-4593-85c9-da18d823c5af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd67ce56-e001-4593-85c9-da18d823c5af', 'volume_size': 1}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b354ab16-3b6b-4c88-b0a5-64ed52fd95d9" returned: 0 in 0.424s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.492s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1622020611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17492bc2-8f7f-4677-ab64-5bcb0d891b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b3f354ecfb4824bacc032471d03155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:07Z,use_quota=True,user_id='12d51a2090f34fa2a831e1ceede74ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Creating volume 17492bc2-8f7f-4677-ab64-5bcb0d891b74 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:43:07 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17492bc2-8f7f-4677-ab64-5bcb0d891b74 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f213fb-ed7b-4602-abc9-87bd93da678c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b354ab16-3b6b-4c88-b0a5-64ed52fd95d9', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4166af7c-3b26-4b0d-8e49-c548a2e202ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:07 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Volume volume-b354ab16-3b6b-4c88-b0a5-64ed52fd95d9 (b354ab16-3b6b-4c88-b0a5-64ed52fd95d9): created successfully
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4166af7c-3b26-4b0d-8e49-c548a2e202ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:07 devstack sudo[101732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17492bc2-8f7f-4677-ab64-5bcb0d891b74 1073741824
Nov 07 02:43:07 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Flow 'volume_create_manager' (5e3fe801-cc23-443c-8418-78d128714ddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:07 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-8b191033-d849-4385-a143-28ff9fc4166a tempest-CreateVolumesFromSnapshotTest-1428766699 None] Created volume successfully.
Nov 07 02:43:07 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-45404d6b-d962-4f6c-8e20-15158ec8818e tempest-SnapshotsActionsTest-2075701007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87.175c3bdd-eeae-4e39-9d34-bd10c2fec932" returned: 0 in 0.334s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-45404d6b-d962-4f6c-8e20-15158ec8818e tempest-SnapshotsActionsTest-2075701007 None] Lock "cinder-quobyte-175c3bdd-eeae-4e39-9d34-bd10c2fec932" released by "_delete_snapshot" :: held 2.186s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-45404d6b-d962-4f6c-8e20-15158ec8818e tempest-SnapshotsActionsTest-2075701007 None] Lock "cinder-quobyte-802920cf-74b2-454f-9c77-19bb9b039f87" released by "delete_snapshot" :: held 2.209s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Flow 'volume_create_manager' (5064e123-ed86-426e-a1ae-69287685145b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4174c2e-ce8a-4e48-aae8-768c07dbd282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4174c2e-ce8a-4e48-aae8-768c07dbd282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-908060300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80372621-fc70-4bfb-844e-f852c91defc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b3f354ecfb4824bacc032471d03155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:08Z,use_quota=True,user_id='12d51a2090f34fa2a831e1ceede74ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8e77d6-5889-409d-9dec-ab638e957d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8e77d6-5889-409d-9dec-ab638e957d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e36ae2-9b1b-41ce-87c5-8fad27abeebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e36ae2-9b1b-41ce-87c5-8fad27abeebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80372621-fc70-4bfb-844e-f852c91defc5', 'volume_name': 'volume-80372621-fc70-4bfb-844e-f852c91defc5', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a702a099-ea89-453b-9ae9-1b4a90e7c5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a702a099-ea89-453b-9ae9-1b4a90e7c5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae117597-6310-4e8d-b076-da1ad63fd266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:07 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Volume 80372621-fc70-4bfb-844e-f852c91defc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80372621-fc70-4bfb-844e-f852c91defc5', 'volume_size': 1}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:07 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-45404d6b-d962-4f6c-8e20-15158ec8818e tempest-SnapshotsActionsTest-2075701007 None] Created reservations ['110ce21a-f03b-4b46-b3e0-cf58423b4fdd', '7faa0a6b-b544-4ca8-a7ec-357a6e16a614', 'c97ed359-44e5-4903-a484-4b8f7d79591c', '73c459f2-3d57-4578-a2a0-63466b41f867'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:08 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-45404d6b-d962-4f6c-8e20-15158ec8818e tempest-SnapshotsActionsTest-2075701007 None] Delete snapshot completed successfully.
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-45404d6b-d962-4f6c-8e20-15158ec8818e tempest-SnapshotsActionsTest-2075701007 None] Lock "cinder-175c3bdd-eeae-4e39-9d34-bd10c2fec932-delete_snapshot" released by "delete_snapshot" :: held 2.636s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:08 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17492bc2-8f7f-4677-ab64-5bcb0d891b74 1073741824" returned: 0 in 0.727s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Flow 'volume_create_manager' (8b25c947-6fae-4d35-adfd-5d318e66c262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59df710d-6401-4dc6-8c70-aebfb09fb8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17492bc2-8f7f-4677-ab64-5bcb0d891b74 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59df710d-6401-4dc6-8c70-aebfb09fb8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1052174990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f0f288-f01d-4faa-bb16-8d8f6b2aa295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b3f354ecfb4824bacc032471d03155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:08Z,use_quota=True,user_id='12d51a2090f34fa2a831e1ceede74ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388d1d22-14a1-4989-8d15-eb54bc03a859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:08 devstack sudo[101740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17492bc2-8f7f-4677-ab64-5bcb0d891b74
Nov 07 02:43:08 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388d1d22-14a1-4989-8d15-eb54bc03a859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3de6a6-e866-4fa3-ad3e-7945f254ea23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3de6a6-e866-4fa3-ad3e-7945f254ea23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14f0f288-f01d-4faa-bb16-8d8f6b2aa295', 'volume_name': 'volume-14f0f288-f01d-4faa-bb16-8d8f6b2aa295', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85673f24-4225-4d11-bb00-8fee4afa7a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85673f24-4225-4d11-bb00-8fee4afa7a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a3c9b0f-5b13-4c8d-a491-58b6101150b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:08 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Volume 14f0f288-f01d-4faa-bb16-8d8f6b2aa295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14f0f288-f01d-4faa-bb16-8d8f6b2aa295', 'volume_size': 1}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:08 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17492bc2-8f7f-4677-ab64-5bcb0d891b74" returned: 0 in 0.273s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.114s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-713996369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd67ce56-e001-4593-85c9-da18d823c5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b3f354ecfb4824bacc032471d03155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:07Z,use_quota=True,user_id='12d51a2090f34fa2a831e1ceede74ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Creating volume dd67ce56-e001-4593-85c9-da18d823c5af {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:43:08 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dd67ce56-e001-4593-85c9-da18d823c5af 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5c76f6-d162-4b96-8876-1cafdf65fa0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17492bc2-8f7f-4677-ab64-5bcb0d891b74', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:08 devstack sudo[101743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dd67ce56-e001-4593-85c9-da18d823c5af 1073741824
Nov 07 02:43:08 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0135d699-0e4e-49e9-b307-fa4acc684508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:08 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Volume volume-17492bc2-8f7f-4677-ab64-5bcb0d891b74 (17492bc2-8f7f-4677-ab64-5bcb0d891b74): created successfully
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0135d699-0e4e-49e9-b307-fa4acc684508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Flow 'volume_create_manager' (c8b9f45c-de13-4e29-a4bf-5810748033bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:08 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b3805196-fd7a-4b60-9b47-0b0bbcd11418 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Created volume successfully.
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b99b4f40-763d-4364-bac4-65a124af5e0d tempest-SnapshotsActionsTest-2075701007 None] Acquiring lock "cinder-802920cf-74b2-454f-9c77-19bb9b039f87-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b99b4f40-763d-4364-bac4-65a124af5e0d tempest-SnapshotsActionsTest-2075701007 None] Lock "cinder-802920cf-74b2-454f-9c77-19bb9b039f87-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b99b4f40-763d-4364-bac4-65a124af5e0d tempest-SnapshotsActionsTest-2075701007 None] Acquiring lock "cinder-quobyte-802920cf-74b2-454f-9c77-19bb9b039f87" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b99b4f40-763d-4364-bac4-65a124af5e0d tempest-SnapshotsActionsTest-2075701007 None] Lock "cinder-quobyte-802920cf-74b2-454f-9c77-19bb9b039f87" acquired by "delete_volume" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[46011786-85eb-4c94-836a-da53f997cb13]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b99b4f40-763d-4364-bac4-65a124af5e0d tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:09 devstack sudo[101748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87
Nov 07 02:43:09 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:09 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dd67ce56-e001-4593-85c9-da18d823c5af 1073741824" returned: 0 in 0.568s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dd67ce56-e001-4593-85c9-da18d823c5af {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:09 devstack sudo[101750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dd67ce56-e001-4593-85c9-da18d823c5af
Nov 07 02:43:09 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:09 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b99b4f40-763d-4364-bac4-65a124af5e0d tempest-SnapshotsActionsTest-2075701007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87" returned: 0 in 0.440s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b99b4f40-763d-4364-bac4-65a124af5e0d tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:09 devstack sudo[101755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87
Nov 07 02:43:09 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:09 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dd67ce56-e001-4593-85c9-da18d823c5af" returned: 0 in 0.287s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.515s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-908060300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80372621-fc70-4bfb-844e-f852c91defc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b3f354ecfb4824bacc032471d03155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:08Z,use_quota=True,user_id='12d51a2090f34fa2a831e1ceede74ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Creating volume 80372621-fc70-4bfb-844e-f852c91defc5 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:43:09 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-80372621-fc70-4bfb-844e-f852c91defc5 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1324cc63-bc74-43b5-942e-5531cb338f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd67ce56-e001-4593-85c9-da18d823c5af', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:09 devstack sudo[101758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-80372621-fc70-4bfb-844e-f852c91defc5 1073741824
Nov 07 02:43:09 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1957f36a-b66c-47de-abe6-6fddd2240154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:09 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Volume volume-dd67ce56-e001-4593-85c9-da18d823c5af (dd67ce56-e001-4593-85c9-da18d823c5af): created successfully
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1957f36a-b66c-47de-abe6-6fddd2240154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Flow 'volume_create_manager' (dcda56c5-6a76-44b2-b86b-e0edff8d421f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:09 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-52a5cc5a-dc94-4ab0-815e-d45ff874d040 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Created volume successfully.
Nov 07 02:43:09 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b99b4f40-763d-4364-bac4-65a124af5e0d tempest-SnapshotsActionsTest-2075701007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-802920cf-74b2-454f-9c77-19bb9b039f87" returned: 0 in 0.296s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b99b4f40-763d-4364-bac4-65a124af5e0d tempest-SnapshotsActionsTest-2075701007 None] Lock "cinder-quobyte-802920cf-74b2-454f-9c77-19bb9b039f87" released by "delete_volume" :: held 0.807s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-b99b4f40-763d-4364-bac4-65a124af5e0d tempest-SnapshotsActionsTest-2075701007 None] Created reservations ['7242b4d0-b83b-405a-908e-c385748277f0', '96800d42-009d-4792-8b1f-c14e3c968497', 'db5a5afd-b352-42ff-8940-717705bbc3cd', '37997607-b977-4caa-b370-366c37e51b4f'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b99b4f40-763d-4364-bac4-65a124af5e0d tempest-SnapshotsActionsTest-2075701007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b99b4f40-763d-4364-bac4-65a124af5e0d tempest-SnapshotsActionsTest-2075701007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b99b4f40-763d-4364-bac4-65a124af5e0d tempest-SnapshotsActionsTest-2075701007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b99b4f40-763d-4364-bac4-65a124af5e0d tempest-SnapshotsActionsTest-2075701007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b99b4f40-763d-4364-bac4-65a124af5e0d tempest-SnapshotsActionsTest-2075701007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b99b4f40-763d-4364-bac4-65a124af5e0d tempest-SnapshotsActionsTest-2075701007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:09 devstack sudo[101764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:43:09 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:10 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-80372621-fc70-4bfb-844e-f852c91defc5 1073741824" returned: 0 in 0.548s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-80372621-fc70-4bfb-844e-f852c91defc5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:10 devstack sudo[101768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-80372621-fc70-4bfb-844e-f852c91defc5
Nov 07 02:43:10 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:10 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b99b4f40-763d-4364-bac4-65a124af5e0d tempest-SnapshotsActionsTest-2075701007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.323s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-b99b4f40-763d-4364-bac4-65a124af5e0d tempest-SnapshotsActionsTest-2075701007 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:10 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b99b4f40-763d-4364-bac4-65a124af5e0d tempest-SnapshotsActionsTest-2075701007 None] Deleted volume successfully.
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b99b4f40-763d-4364-bac4-65a124af5e0d tempest-SnapshotsActionsTest-2075701007 None] Lock "cinder-802920cf-74b2-454f-9c77-19bb9b039f87-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:10 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-80372621-fc70-4bfb-844e-f852c91defc5" returned: 0 in 0.333s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.100s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1052174990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f0f288-f01d-4faa-bb16-8d8f6b2aa295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b3f354ecfb4824bacc032471d03155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:08Z,use_quota=True,user_id='12d51a2090f34fa2a831e1ceede74ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Creating volume 14f0f288-f01d-4faa-bb16-8d8f6b2aa295 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:43:10 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-14f0f288-f01d-4faa-bb16-8d8f6b2aa295 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae117597-6310-4e8d-b076-da1ad63fd266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80372621-fc70-4bfb-844e-f852c91defc5', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e7149c-1b52-4577-8863-da1ed311621e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:10 devstack sudo[101771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-14f0f288-f01d-4faa-bb16-8d8f6b2aa295 1073741824
Nov 07 02:43:10 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:10 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Volume volume-80372621-fc70-4bfb-844e-f852c91defc5 (80372621-fc70-4bfb-844e-f852c91defc5): created successfully
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e7149c-1b52-4577-8863-da1ed311621e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Flow 'volume_create_manager' (5064e123-ed86-426e-a1ae-69287685145b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:10 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-0c7a4d38-c1bb-4b40-a654-4113d163c874 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Created volume successfully.
Nov 07 02:43:10 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-14f0f288-f01d-4faa-bb16-8d8f6b2aa295 1073741824" returned: 0 in 0.513s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-14f0f288-f01d-4faa-bb16-8d8f6b2aa295 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:11 devstack sudo[101777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-14f0f288-f01d-4faa-bb16-8d8f6b2aa295
Nov 07 02:43:11 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:11 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-14f0f288-f01d-4faa-bb16-8d8f6b2aa295" returned: 0 in 0.296s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a3c9b0f-5b13-4c8d-a491-58b6101150b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14f0f288-f01d-4faa-bb16-8d8f6b2aa295', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e57dc3-7323-4b80-9587-bd4029060d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:11 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Volume volume-14f0f288-f01d-4faa-bb16-8d8f6b2aa295 (14f0f288-f01d-4faa-bb16-8d8f6b2aa295): created successfully
Nov 07 02:43:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e57dc3-7323-4b80-9587-bd4029060d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Flow 'volume_create_manager' (8b25c947-6fae-4d35-adfd-5d318e66c262) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:11 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c6b61fa5-b398-4576-b49e-5e7b47fc1526 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Created volume successfully.
Nov 07 02:43:11 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-255ee13a-a163-4def-93f9-755a243a982b tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "cinder-14f0f288-f01d-4faa-bb16-8d8f6b2aa295-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:11 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-255ee13a-a163-4def-93f9-755a243a982b tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-14f0f288-f01d-4faa-bb16-8d8f6b2aa295-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:11 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-255ee13a-a163-4def-93f9-755a243a982b tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "cinder-quobyte-14f0f288-f01d-4faa-bb16-8d8f6b2aa295" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:11 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-255ee13a-a163-4def-93f9-755a243a982b tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-quobyte-14f0f288-f01d-4faa-bb16-8d8f6b2aa295" acquired by "delete_volume" :: waited 0.019s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:11 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[f883b7fc-6d43-4e47-aa75-50c80d5a467a]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-255ee13a-a163-4def-93f9-755a243a982b tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-14f0f288-f01d-4faa-bb16-8d8f6b2aa295 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:11 devstack sudo[101780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-14f0f288-f01d-4faa-bb16-8d8f6b2aa295
Nov 07 02:43:11 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:12 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-255ee13a-a163-4def-93f9-755a243a982b tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-14f0f288-f01d-4faa-bb16-8d8f6b2aa295" returned: 0 in 0.432s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-255ee13a-a163-4def-93f9-755a243a982b tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-14f0f288-f01d-4faa-bb16-8d8f6b2aa295 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:12 devstack sudo[101785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-14f0f288-f01d-4faa-bb16-8d8f6b2aa295
Nov 07 02:43:12 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:12 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-255ee13a-a163-4def-93f9-755a243a982b tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-14f0f288-f01d-4faa-bb16-8d8f6b2aa295" returned: 0 in 0.297s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:12 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-255ee13a-a163-4def-93f9-755a243a982b tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-quobyte-14f0f288-f01d-4faa-bb16-8d8f6b2aa295" released by "delete_volume" :: held 0.793s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:12 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-255ee13a-a163-4def-93f9-755a243a982b tempest-CreateVolumesFromSnapshotTest-1428766699 None] Created reservations ['fe6e950c-64b0-4b57-9a09-e69db25855ca', '4a4b8d5d-29c5-4279-80b7-79f603d0a80e', 'cc317ec6-2089-4f7a-af95-3df73dfb2fef', 'bdd2ce12-1f6d-4081-894f-41f5caa6094f'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-255ee13a-a163-4def-93f9-755a243a982b tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-255ee13a-a163-4def-93f9-755a243a982b tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-255ee13a-a163-4def-93f9-755a243a982b tempest-CreateVolumesFromSnapshotTest-1428766699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-255ee13a-a163-4def-93f9-755a243a982b tempest-CreateVolumesFromSnapshotTest-1428766699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-255ee13a-a163-4def-93f9-755a243a982b tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-255ee13a-a163-4def-93f9-755a243a982b tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:12 devstack sudo[101788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:43:12 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:12 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-943993d7-4b08-47fc-83d0-71321016da39 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "cinder-80372621-fc70-4bfb-844e-f852c91defc5-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:12 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-943993d7-4b08-47fc-83d0-71321016da39 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-80372621-fc70-4bfb-844e-f852c91defc5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:12 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-943993d7-4b08-47fc-83d0-71321016da39 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "cinder-quobyte-80372621-fc70-4bfb-844e-f852c91defc5" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:12 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-943993d7-4b08-47fc-83d0-71321016da39 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-quobyte-80372621-fc70-4bfb-844e-f852c91defc5" acquired by "delete_volume" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:12 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[26732b54-22a2-4be2-8479-792042f40738]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-943993d7-4b08-47fc-83d0-71321016da39 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-80372621-fc70-4bfb-844e-f852c91defc5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:12 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-255ee13a-a163-4def-93f9-755a243a982b tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.347s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:13 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-255ee13a-a163-4def-93f9-755a243a982b tempest-CreateVolumesFromSnapshotTest-1428766699 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:13 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-255ee13a-a163-4def-93f9-755a243a982b tempest-CreateVolumesFromSnapshotTest-1428766699 None] Deleted volume successfully.
Nov 07 02:43:13 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-255ee13a-a163-4def-93f9-755a243a982b tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-14f0f288-f01d-4faa-bb16-8d8f6b2aa295-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:13 devstack sudo[101791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-80372621-fc70-4bfb-844e-f852c91defc5
Nov 07 02:43:13 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:13 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-943993d7-4b08-47fc-83d0-71321016da39 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-80372621-fc70-4bfb-844e-f852c91defc5" returned: 0 in 0.460s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-943993d7-4b08-47fc-83d0-71321016da39 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-80372621-fc70-4bfb-844e-f852c91defc5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:13 devstack sudo[101796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-80372621-fc70-4bfb-844e-f852c91defc5
Nov 07 02:43:13 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:13 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-943993d7-4b08-47fc-83d0-71321016da39 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-80372621-fc70-4bfb-844e-f852c91defc5" returned: 0 in 0.317s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:13 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-943993d7-4b08-47fc-83d0-71321016da39 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-quobyte-80372621-fc70-4bfb-844e-f852c91defc5" released by "delete_volume" :: held 0.835s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:13 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-943993d7-4b08-47fc-83d0-71321016da39 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Created reservations ['38109e5f-eff2-4495-805d-c9a80ff0413b', 'ffb6de33-ca86-426a-82c8-17a4a48eb235', 'c1ecba3f-3cd3-4450-a1f3-b30c6f24717e', '8b1b51f3-a179-4703-a7ad-540e43a288ba'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-943993d7-4b08-47fc-83d0-71321016da39 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-943993d7-4b08-47fc-83d0-71321016da39 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-943993d7-4b08-47fc-83d0-71321016da39 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-943993d7-4b08-47fc-83d0-71321016da39 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-943993d7-4b08-47fc-83d0-71321016da39 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-943993d7-4b08-47fc-83d0-71321016da39 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:13 devstack sudo[101799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:43:13 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:14 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-296d06cd-7b99-417f-a9b7-1baa60ae4811 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "cinder-dd67ce56-e001-4593-85c9-da18d823c5af-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:14 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-296d06cd-7b99-417f-a9b7-1baa60ae4811 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-dd67ce56-e001-4593-85c9-da18d823c5af-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:14 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-296d06cd-7b99-417f-a9b7-1baa60ae4811 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "cinder-quobyte-dd67ce56-e001-4593-85c9-da18d823c5af" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:14 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-296d06cd-7b99-417f-a9b7-1baa60ae4811 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-quobyte-dd67ce56-e001-4593-85c9-da18d823c5af" acquired by "delete_volume" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:14 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f0ffde-2827-4e28-b04f-4440d6494786]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-296d06cd-7b99-417f-a9b7-1baa60ae4811 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dd67ce56-e001-4593-85c9-da18d823c5af {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:14 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-943993d7-4b08-47fc-83d0-71321016da39 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.446s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:14 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-943993d7-4b08-47fc-83d0-71321016da39 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:14 devstack sudo[101801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dd67ce56-e001-4593-85c9-da18d823c5af
Nov 07 02:43:14 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:14 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-943993d7-4b08-47fc-83d0-71321016da39 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Deleted volume successfully.
Nov 07 02:43:14 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-943993d7-4b08-47fc-83d0-71321016da39 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-80372621-fc70-4bfb-844e-f852c91defc5-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:14 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-296d06cd-7b99-417f-a9b7-1baa60ae4811 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dd67ce56-e001-4593-85c9-da18d823c5af" returned: 0 in 0.401s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-296d06cd-7b99-417f-a9b7-1baa60ae4811 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dd67ce56-e001-4593-85c9-da18d823c5af {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:14 devstack sudo[101813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dd67ce56-e001-4593-85c9-da18d823c5af
Nov 07 02:43:14 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:14 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-296d06cd-7b99-417f-a9b7-1baa60ae4811 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dd67ce56-e001-4593-85c9-da18d823c5af" returned: 0 in 0.260s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:14 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-296d06cd-7b99-417f-a9b7-1baa60ae4811 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-quobyte-dd67ce56-e001-4593-85c9-da18d823c5af" released by "delete_volume" :: held 0.736s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:14 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-296d06cd-7b99-417f-a9b7-1baa60ae4811 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Created reservations ['0ec3be3f-fafe-48a2-b1eb-0e9782ab4d74', '66bc20f6-6d09-4785-9fab-d18536f85409', '0fd90bee-a22f-41c3-8855-97605b45281a', '75f6b76b-801a-4992-97bf-f469f7f526dc'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-296d06cd-7b99-417f-a9b7-1baa60ae4811 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-296d06cd-7b99-417f-a9b7-1baa60ae4811 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-296d06cd-7b99-417f-a9b7-1baa60ae4811 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-296d06cd-7b99-417f-a9b7-1baa60ae4811 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-296d06cd-7b99-417f-a9b7-1baa60ae4811 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-296d06cd-7b99-417f-a9b7-1baa60ae4811 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:15 devstack sudo[101816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:43:15 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-4effb00d-f25b-4cc5-938e-d5700ca001af tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "cinder-17492bc2-8f7f-4677-ab64-5bcb0d891b74-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-4effb00d-f25b-4cc5-938e-d5700ca001af tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-17492bc2-8f7f-4677-ab64-5bcb0d891b74-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:15 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=147,cinder:UPDATE=172,cinder:INSERT=51,cinder:DELETE=16 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:43:15 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=141,cinder:UPDATE=170,cinder:INSERT=46,cinder:DELETE=13 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:43:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-4effb00d-f25b-4cc5-938e-d5700ca001af tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "cinder-quobyte-17492bc2-8f7f-4677-ab64-5bcb0d891b74" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-4effb00d-f25b-4cc5-938e-d5700ca001af tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-quobyte-17492bc2-8f7f-4677-ab64-5bcb0d891b74" acquired by "delete_volume" :: waited 0.021s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:15 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-296d06cd-7b99-417f-a9b7-1baa60ae4811 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.501s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:15 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-296d06cd-7b99-417f-a9b7-1baa60ae4811 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:15 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11b1fb9-6391-44f1-81a9-a20b5e74065b]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4effb00d-f25b-4cc5-938e-d5700ca001af tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17492bc2-8f7f-4677-ab64-5bcb0d891b74 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:15 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-296d06cd-7b99-417f-a9b7-1baa60ae4811 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Deleted volume successfully.
Nov 07 02:43:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-296d06cd-7b99-417f-a9b7-1baa60ae4811 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-dd67ce56-e001-4593-85c9-da18d823c5af-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:15 devstack sudo[101819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17492bc2-8f7f-4677-ab64-5bcb0d891b74
Nov 07 02:43:15 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:16 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4effb00d-f25b-4cc5-938e-d5700ca001af tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17492bc2-8f7f-4677-ab64-5bcb0d891b74" returned: 0 in 0.451s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4effb00d-f25b-4cc5-938e-d5700ca001af tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17492bc2-8f7f-4677-ab64-5bcb0d891b74 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:16 devstack sudo[101824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17492bc2-8f7f-4677-ab64-5bcb0d891b74
Nov 07 02:43:16 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:16 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4effb00d-f25b-4cc5-938e-d5700ca001af tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-17492bc2-8f7f-4677-ab64-5bcb0d891b74" returned: 0 in 0.309s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-4effb00d-f25b-4cc5-938e-d5700ca001af tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-quobyte-17492bc2-8f7f-4677-ab64-5bcb0d891b74" released by "delete_volume" :: held 0.831s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:16 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-4effb00d-f25b-4cc5-938e-d5700ca001af tempest-CreateVolumesFromSnapshotTest-1428766699 None] Created reservations ['ec729341-4408-4f6a-8a0a-6d4513f6f7c9', '026e5f65-f825-47f2-95d6-b76c306fb9c2', '63e8e226-756b-4f0c-955f-867e50e4ff8c', '3839e600-3d00-4059-8da1-23f209eb8da8'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-4effb00d-f25b-4cc5-938e-d5700ca001af tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-4effb00d-f25b-4cc5-938e-d5700ca001af tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-4effb00d-f25b-4cc5-938e-d5700ca001af tempest-CreateVolumesFromSnapshotTest-1428766699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-4effb00d-f25b-4cc5-938e-d5700ca001af tempest-CreateVolumesFromSnapshotTest-1428766699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-4effb00d-f25b-4cc5-938e-d5700ca001af tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4effb00d-f25b-4cc5-938e-d5700ca001af tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:16 devstack sudo[101827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:43:16 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-37e1be18-4c82-4bd0-b1f6-3c539d472e47 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "cinder-b354ab16-3b6b-4c88-b0a5-64ed52fd95d9-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-37e1be18-4c82-4bd0-b1f6-3c539d472e47 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-b354ab16-3b6b-4c88-b0a5-64ed52fd95d9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-37e1be18-4c82-4bd0-b1f6-3c539d472e47 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "cinder-quobyte-b354ab16-3b6b-4c88-b0a5-64ed52fd95d9" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-37e1be18-4c82-4bd0-b1f6-3c539d472e47 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-quobyte-b354ab16-3b6b-4c88-b0a5-64ed52fd95d9" acquired by "delete_volume" :: waited 0.034s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:16 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[eead4886-df46-4dfd-9d28-ff8900944e36]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-37e1be18-4c82-4bd0-b1f6-3c539d472e47 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b354ab16-3b6b-4c88-b0a5-64ed52fd95d9 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:16 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4effb00d-f25b-4cc5-938e-d5700ca001af tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.404s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:16 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-4effb00d-f25b-4cc5-938e-d5700ca001af tempest-CreateVolumesFromSnapshotTest-1428766699 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:16 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-4effb00d-f25b-4cc5-938e-d5700ca001af tempest-CreateVolumesFromSnapshotTest-1428766699 None] Deleted volume successfully.
Nov 07 02:43:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-4effb00d-f25b-4cc5-938e-d5700ca001af tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-17492bc2-8f7f-4677-ab64-5bcb0d891b74-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:17 devstack sudo[101829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b354ab16-3b6b-4c88-b0a5-64ed52fd95d9
Nov 07 02:43:17 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:17 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-37e1be18-4c82-4bd0-b1f6-3c539d472e47 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b354ab16-3b6b-4c88-b0a5-64ed52fd95d9" returned: 0 in 0.529s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-37e1be18-4c82-4bd0-b1f6-3c539d472e47 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b354ab16-3b6b-4c88-b0a5-64ed52fd95d9 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:17 devstack sudo[101835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b354ab16-3b6b-4c88-b0a5-64ed52fd95d9
Nov 07 02:43:17 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:17 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-37e1be18-4c82-4bd0-b1f6-3c539d472e47 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b354ab16-3b6b-4c88-b0a5-64ed52fd95d9" returned: 0 in 0.323s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:17 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-37e1be18-4c82-4bd0-b1f6-3c539d472e47 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-quobyte-b354ab16-3b6b-4c88-b0a5-64ed52fd95d9" released by "delete_volume" :: held 0.941s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:17 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-37e1be18-4c82-4bd0-b1f6-3c539d472e47 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Created reservations ['41b2d64e-7efe-459b-b69c-e7f5d50406fb', '93a2da4d-8f6e-457f-9bc2-6a33865b465c', 'e5398c56-9e7e-4fcc-9760-ad18fbdadcec', '1fde15b7-87ce-4e47-a57c-d3e9906ea166'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-37e1be18-4c82-4bd0-b1f6-3c539d472e47 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-37e1be18-4c82-4bd0-b1f6-3c539d472e47 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-37e1be18-4c82-4bd0-b1f6-3c539d472e47 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-37e1be18-4c82-4bd0-b1f6-3c539d472e47 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-37e1be18-4c82-4bd0-b1f6-3c539d472e47 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-37e1be18-4c82-4bd0-b1f6-3c539d472e47 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:17 devstack sudo[101839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:43:17 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:18 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-37e1be18-4c82-4bd0-b1f6-3c539d472e47 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.311s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:18 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-37e1be18-4c82-4bd0-b1f6-3c539d472e47 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:18 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-37e1be18-4c82-4bd0-b1f6-3c539d472e47 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Deleted volume successfully.
Nov 07 02:43:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-37e1be18-4c82-4bd0-b1f6-3c539d472e47 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-b354ab16-3b6b-4c88-b0a5-64ed52fd95d9-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-939189ca-36d7-4a27-aeb9-988a265bfb74 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "cinder-65a53fa6-2aa5-4b0b-8c04-6de9a965cc31-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-939189ca-36d7-4a27-aeb9-988a265bfb74 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-65a53fa6-2aa5-4b0b-8c04-6de9a965cc31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-939189ca-36d7-4a27-aeb9-988a265bfb74 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "cinder-quobyte-29ff49fa-8dba-436a-bfce-3658f81cebbe" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-939189ca-36d7-4a27-aeb9-988a265bfb74 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-quobyte-29ff49fa-8dba-436a-bfce-3658f81cebbe" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-939189ca-36d7-4a27-aeb9-988a265bfb74 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "cinder-quobyte-65a53fa6-2aa5-4b0b-8c04-6de9a965cc31" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-939189ca-36d7-4a27-aeb9-988a265bfb74 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-quobyte-65a53fa6-2aa5-4b0b-8c04-6de9a965cc31" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-939189ca-36d7-4a27-aeb9-988a265bfb74 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Deleting offline snapshot 65a53fa6-2aa5-4b0b-8c04-6de9a965cc31 of volume 29ff49fa-8dba-436a-bfce-3658f81cebbe {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:43:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-939189ca-36d7-4a27-aeb9-988a265bfb74 tempest-CreateVolumesFromSnapshotTest-1428766699 None] snapshot_file for this snap is: volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.65a53fa6-2aa5-4b0b-8c04-6de9a965cc31 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:43:19 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad53ea9-2819-4453-b551-98bbe67e8675]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-939189ca-36d7-4a27-aeb9-988a265bfb74 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.65a53fa6-2aa5-4b0b-8c04-6de9a965cc31 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:19 devstack sudo[101842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.65a53fa6-2aa5-4b0b-8c04-6de9a965cc31
Nov 07 02:43:19 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:19 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-939189ca-36d7-4a27-aeb9-988a265bfb74 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.65a53fa6-2aa5-4b0b-8c04-6de9a965cc31" returned: 0 in 0.438s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-939189ca-36d7-4a27-aeb9-988a265bfb74 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29ff49fa-8dba-436a-bfce-3658f81cebbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:43:19 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a596f1-877c-4324-b743-6069797d7066]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-939189ca-36d7-4a27-aeb9-988a265bfb74 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:19 devstack sudo[101848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe
Nov 07 02:43:19 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:20 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-939189ca-36d7-4a27-aeb9-988a265bfb74 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe" returned: 0 in 0.455s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-939189ca-36d7-4a27-aeb9-988a265bfb74 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.65a53fa6-2aa5-4b0b-8c04-6de9a965cc31 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:20 devstack sudo[101854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.65a53fa6-2aa5-4b0b-8c04-6de9a965cc31
Nov 07 02:43:20 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:20 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-939189ca-36d7-4a27-aeb9-988a265bfb74 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.65a53fa6-2aa5-4b0b-8c04-6de9a965cc31" returned: 0 in 0.459s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-939189ca-36d7-4a27-aeb9-988a265bfb74 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.65a53fa6-2aa5-4b0b-8c04-6de9a965cc31 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:20 devstack sudo[101860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.65a53fa6-2aa5-4b0b-8c04-6de9a965cc31
Nov 07 02:43:20 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:20 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-939189ca-36d7-4a27-aeb9-988a265bfb74 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe.65a53fa6-2aa5-4b0b-8c04-6de9a965cc31" returned: 0 in 0.370s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-939189ca-36d7-4a27-aeb9-988a265bfb74 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-quobyte-65a53fa6-2aa5-4b0b-8c04-6de9a965cc31" released by "_delete_snapshot" :: held 1.903s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-939189ca-36d7-4a27-aeb9-988a265bfb74 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-quobyte-29ff49fa-8dba-436a-bfce-3658f81cebbe" released by "delete_snapshot" :: held 1.940s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:20 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-939189ca-36d7-4a27-aeb9-988a265bfb74 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Created reservations ['2dcc025e-d442-438e-962b-60dc1f88eb8b', 'dd22a2fd-59bf-42ff-95c6-8600d6b8dd4d', '0effb145-663f-488c-9ac7-9137ac451680', 'e21bc78f-592e-4476-800e-8f5738d2939c'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:21 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-939189ca-36d7-4a27-aeb9-988a265bfb74 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Delete snapshot completed successfully.
Nov 07 02:43:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-939189ca-36d7-4a27-aeb9-988a265bfb74 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-65a53fa6-2aa5-4b0b-8c04-6de9a965cc31-delete_snapshot" released by "delete_snapshot" :: held 2.182s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-913b1a17-d814-4a4b-899e-89815ec0ec31 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "cinder-29ff49fa-8dba-436a-bfce-3658f81cebbe-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-913b1a17-d814-4a4b-899e-89815ec0ec31 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-29ff49fa-8dba-436a-bfce-3658f81cebbe-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-913b1a17-d814-4a4b-899e-89815ec0ec31 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "cinder-quobyte-29ff49fa-8dba-436a-bfce-3658f81cebbe" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-913b1a17-d814-4a4b-899e-89815ec0ec31 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-quobyte-29ff49fa-8dba-436a-bfce-3658f81cebbe" acquired by "delete_volume" :: waited 0.018s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:21 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da0e99e-e594-491e-8b1a-f408709a0cba]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-913b1a17-d814-4a4b-899e-89815ec0ec31 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:21 devstack sudo[101863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe
Nov 07 02:43:21 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:21 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-913b1a17-d814-4a4b-899e-89815ec0ec31 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe" returned: 0 in 0.382s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-913b1a17-d814-4a4b-899e-89815ec0ec31 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:21 devstack sudo[101868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe
Nov 07 02:43:21 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:22 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-913b1a17-d814-4a4b-899e-89815ec0ec31 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-29ff49fa-8dba-436a-bfce-3658f81cebbe" returned: 0 in 0.313s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:22 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-913b1a17-d814-4a4b-899e-89815ec0ec31 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-quobyte-29ff49fa-8dba-436a-bfce-3658f81cebbe" released by "delete_volume" :: held 0.811s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:22 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-913b1a17-d814-4a4b-899e-89815ec0ec31 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Created reservations ['676eee0f-be9b-4387-99a0-402b39763568', '516fde35-a4db-4146-a250-7593967dbfd8', '9bf386ed-6e00-4ae4-988c-89cc70e26cc1', 'dd424065-082e-4fec-96b4-5a7f9cdc27f0'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-913b1a17-d814-4a4b-899e-89815ec0ec31 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-913b1a17-d814-4a4b-899e-89815ec0ec31 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:22 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-913b1a17-d814-4a4b-899e-89815ec0ec31 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:22 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-913b1a17-d814-4a4b-899e-89815ec0ec31 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-913b1a17-d814-4a4b-899e-89815ec0ec31 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-913b1a17-d814-4a4b-899e-89815ec0ec31 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:22 devstack sudo[101871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:43:22 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:22 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-913b1a17-d814-4a4b-899e-89815ec0ec31 tempest-CreateVolumesFromSnapshotTest-1428766699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.342s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:22 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-913b1a17-d814-4a4b-899e-89815ec0ec31 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:22 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-913b1a17-d814-4a4b-899e-89815ec0ec31 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Deleted volume successfully.
Nov 07 02:43:22 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-913b1a17-d814-4a4b-899e-89815ec0ec31 tempest-CreateVolumesFromSnapshotTest-1428766699 None] Lock "cinder-29ff49fa-8dba-436a-bfce-3658f81cebbe-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Flow 'volume_create_manager' (86f35534-bb62-404e-ab5b-7e5d2e992c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f762095-4a1e-4c6d-bffe-a4d0dac8e4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f762095-4a1e-4c6d-bffe-a4d0dac8e4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1451121027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef9008f5-2554-452d-9b7e-3e5cde59a52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07619612b58148fe9f831af2bf729e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:26Z,use_quota=True,user_id='b297a1574bf64bddb1a6fef2ec30a8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fb9b025-83aa-4f26-81a6-631d457c9125),volume_type_id=6fb9b025-83aa-4f26-81a6-631d457c9125)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2955f031-2d40-47e6-b06b-cecba040d1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2955f031-2d40-47e6-b06b-cecba040d1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9ff181-4a33-4014-a806-1f119856702d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9ff181-4a33-4014-a806-1f119856702d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef9008f5-2554-452d-9b7e-3e5cde59a52b', 'volume_name': 'volume-ef9008f5-2554-452d-9b7e-3e5cde59a52b', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4e28de-3130-4586-b6d0-589759641282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4e28de-3130-4586-b6d0-589759641282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2698e981-354c-477b-8605-2634b639ec82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:26 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Volume ef9008f5-2554-452d-9b7e-3e5cde59a52b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef9008f5-2554-452d-9b7e-3e5cde59a52b', 'volume_size': 1}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1451121027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef9008f5-2554-452d-9b7e-3e5cde59a52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07619612b58148fe9f831af2bf729e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:26Z,use_quota=True,user_id='b297a1574bf64bddb1a6fef2ec30a8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fb9b025-83aa-4f26-81a6-631d457c9125),volume_type_id=6fb9b025-83aa-4f26-81a6-631d457c9125)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Creating volume ef9008f5-2554-452d-9b7e-3e5cde59a52b {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:43:26 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ef9008f5-2554-452d-9b7e-3e5cde59a52b 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:43:26 devstack sudo[101875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ef9008f5-2554-452d-9b7e-3e5cde59a52b 1073741824
Nov 07 02:43:26 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Flow 'volume_create_manager' (d94edd36-1c61-4239-90e1-bdf00a5ce2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15eb1254-10bd-41e4-a9bd-e90eed6c7fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15eb1254-10bd-41e4-a9bd-e90eed6c7fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-99330572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b3a36f-2b26-4112-b6b5-87f15ff82112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b713629b63146dba7ea2e3dc82103bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:26Z,use_quota=True,user_id='78d224d06ff54fdca571c3056034ab45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d351ab-0078-4942-85d5-dba77000e3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d351ab-0078-4942-85d5-dba77000e3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7822ae3-b17a-48f8-93c8-4f92677c25d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7822ae3-b17a-48f8-93c8-4f92677c25d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76b3a36f-2b26-4112-b6b5-87f15ff82112', 'volume_name': 'volume-76b3a36f-2b26-4112-b6b5-87f15ff82112', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11535fa2-7912-4dbb-aff1-cfab1f3f15ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11535fa2-7912-4dbb-aff1-cfab1f3f15ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b1e75e-a670-4704-8d91-6b317b6232f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:26 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Volume 76b3a36f-2b26-4112-b6b5-87f15ff82112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76b3a36f-2b26-4112-b6b5-87f15ff82112', 'volume_size': 1}
Nov 07 02:43:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:27 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ef9008f5-2554-452d-9b7e-3e5cde59a52b 1073741824" returned: 0 in 0.580s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ef9008f5-2554-452d-9b7e-3e5cde59a52b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:27 devstack sudo[101881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ef9008f5-2554-452d-9b7e-3e5cde59a52b
Nov 07 02:43:27 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:27 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ef9008f5-2554-452d-9b7e-3e5cde59a52b" returned: 0 in 0.268s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.780s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-99330572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b3a36f-2b26-4112-b6b5-87f15ff82112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b713629b63146dba7ea2e3dc82103bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:26Z,use_quota=True,user_id='78d224d06ff54fdca571c3056034ab45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:43:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Creating volume 76b3a36f-2b26-4112-b6b5-87f15ff82112 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:43:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:43:27 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:43:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-76b3a36f-2b26-4112-b6b5-87f15ff82112 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2698e981-354c-477b-8605-2634b639ec82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef9008f5-2554-452d-9b7e-3e5cde59a52b', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0171252e-76b5-4de0-8504-62bb03583e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:27 devstack sudo[101884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-76b3a36f-2b26-4112-b6b5-87f15ff82112 1073741824
Nov 07 02:43:27 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:27 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Volume volume-ef9008f5-2554-452d-9b7e-3e5cde59a52b (ef9008f5-2554-452d-9b7e-3e5cde59a52b): created successfully
Nov 07 02:43:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0171252e-76b5-4de0-8504-62bb03583e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Flow 'volume_create_manager' (86f35534-bb62-404e-ab5b-7e5d2e992c2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:27 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-9ca09ed7-6aef-481d-9a3a-96c5d06625de tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Created volume successfully.
Nov 07 02:43:27 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-76b3a36f-2b26-4112-b6b5-87f15ff82112 1073741824" returned: 0 in 0.469s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-76b3a36f-2b26-4112-b6b5-87f15ff82112 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:27 devstack sudo[101892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-76b3a36f-2b26-4112-b6b5-87f15ff82112
Nov 07 02:43:27 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:28 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-76b3a36f-2b26-4112-b6b5-87f15ff82112" returned: 0 in 0.246s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b1e75e-a670-4704-8d91-6b317b6232f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76b3a36f-2b26-4112-b6b5-87f15ff82112', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b5e131c-0f17-4ba4-b737-71aabf4dfa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:28 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Volume volume-76b3a36f-2b26-4112-b6b5-87f15ff82112 (76b3a36f-2b26-4112-b6b5-87f15ff82112): created successfully
Nov 07 02:43:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b5e131c-0f17-4ba4-b737-71aabf4dfa02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Flow 'volume_create_manager' (d94edd36-1c61-4239-90e1-bdf00a5ce2e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:28 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ac316cb4-940f-4166-b973-e948ec77d594 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Created volume successfully.
Nov 07 02:43:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2094fbd7-1225-4cb3-8ca2-47a2193c4ea8 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2094fbd7-1225-4cb3-8ca2-47a2193c4ea8 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2094fbd7-1225-4cb3-8ca2-47a2193c4ea8 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2094fbd7-1225-4cb3-8ca2-47a2193c4ea8 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2094fbd7-1225-4cb3-8ca2-47a2193c4ea8 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2094fbd7-1225-4cb3-8ca2-47a2193c4ea8 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:28 devstack sudo[101896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:43:28 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:28 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Flow 'volume_create_manager' (6fc3a685-4d98-478d-a396-f82a72165e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3277a8a-ae4a-4dce-adee-f0c7aee82c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3277a8a-ae4a-4dce-adee-f0c7aee82c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2132370427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9526b00-0085-4379-a70a-c98c5b11dcec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b713629b63146dba7ea2e3dc82103bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:29Z,use_quota=True,user_id='78d224d06ff54fdca571c3056034ab45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36045df6-a2fc-40f0-8803-cb71c1d99f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36045df6-a2fc-40f0-8803-cb71c1d99f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c300530-ac39-4069-92c0-f33738300ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c300530-ac39-4069-92c0-f33738300ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9526b00-0085-4379-a70a-c98c5b11dcec', 'volume_name': 'volume-f9526b00-0085-4379-a70a-c98c5b11dcec', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ed4ec8-6a65-471d-8345-db0d723e040d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ed4ec8-6a65-471d-8345-db0d723e040d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260467f3-a43e-4a25-911d-c2abd249e266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:29 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Volume f9526b00-0085-4379-a70a-c98c5b11dcec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9526b00-0085-4379-a70a-c98c5b11dcec', 'volume_size': 1}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2132370427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9526b00-0085-4379-a70a-c98c5b11dcec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b713629b63146dba7ea2e3dc82103bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:29Z,use_quota=True,user_id='78d224d06ff54fdca571c3056034ab45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Creating volume f9526b00-0085-4379-a70a-c98c5b11dcec {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:43:29 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f9526b00-0085-4379-a70a-c98c5b11dcec 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:29 devstack sudo[101899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f9526b00-0085-4379-a70a-c98c5b11dcec 1073741824
Nov 07 02:43:29 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:29 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2094fbd7-1225-4cb3-8ca2-47a2193c4ea8 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.359s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-2094fbd7-1225-4cb3-8ca2-47a2193c4ea8 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:29 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-2094fbd7-1225-4cb3-8ca2-47a2193c4ea8 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Retype volume completed successfully.
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Flow 'volume_create_manager' (1935ec2d-f430-4671-a248-891b7026ebe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e531720-7d59-42e3-9d66-930a02a13eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e531720-7d59-42e3-9d66-930a02a13eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-62405414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40921404-bdc9-4664-8a02-bc791f75ae3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b713629b63146dba7ea2e3dc82103bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:29Z,use_quota=True,user_id='78d224d06ff54fdca571c3056034ab45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3451aa0c-0117-4b6c-bd7a-3c8eff8e9a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3451aa0c-0117-4b6c-bd7a-3c8eff8e9a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec3cb19c-eb9c-4a61-8209-e8c69341eac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec3cb19c-eb9c-4a61-8209-e8c69341eac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40921404-bdc9-4664-8a02-bc791f75ae3c', 'volume_name': 'volume-40921404-bdc9-4664-8a02-bc791f75ae3c', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d25ef95-f063-4971-a270-0f3cba30ee0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d25ef95-f063-4971-a270-0f3cba30ee0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8a1677-9836-4e20-b6b9-2352598654d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:29 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Volume 40921404-bdc9-4664-8a02-bc791f75ae3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40921404-bdc9-4664-8a02-bc791f75ae3c', 'volume_size': 1}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:29 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f9526b00-0085-4379-a70a-c98c5b11dcec 1073741824" returned: 0 in 0.613s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f9526b00-0085-4379-a70a-c98c5b11dcec {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:29 devstack sudo[101906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f9526b00-0085-4379-a70a-c98c5b11dcec
Nov 07 02:43:29 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Flow 'volume_create_manager' (190e46dc-f90a-4924-9fcb-ed149857d115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165f932e-00d3-436f-9ea5-b6d91e09ae1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165f932e-00d3-436f-9ea5-b6d91e09ae1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1039816146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b98c5cf-ddf1-4121-9598-502d88df979c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b713629b63146dba7ea2e3dc82103bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:30Z,use_quota=True,user_id='78d224d06ff54fdca571c3056034ab45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d8e916-b927-4456-81b7-78cdf44be466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d8e916-b927-4456-81b7-78cdf44be466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00de2cd-c107-468d-95f9-64710323a113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00de2cd-c107-468d-95f9-64710323a113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b98c5cf-ddf1-4121-9598-502d88df979c', 'volume_name': 'volume-4b98c5cf-ddf1-4121-9598-502d88df979c', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f379f8dd-bec4-4bbf-a1ab-bfeb21693b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f379f8dd-bec4-4bbf-a1ab-bfeb21693b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7c6f38-255f-4da0-98ff-bca1777eddc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:29 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Volume 4b98c5cf-ddf1-4121-9598-502d88df979c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b98c5cf-ddf1-4121-9598-502d88df979c', 'volume_size': 1}
Nov 07 02:43:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d090a5c3-2dd9-495d-9821-677aff32c2e4 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Acquiring lock "cinder-ef9008f5-2554-452d-9b7e-3e5cde59a52b-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d090a5c3-2dd9-495d-9821-677aff32c2e4 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Lock "cinder-ef9008f5-2554-452d-9b7e-3e5cde59a52b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:30 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f9526b00-0085-4379-a70a-c98c5b11dcec" returned: 0 in 0.549s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.858s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-62405414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40921404-bdc9-4664-8a02-bc791f75ae3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b713629b63146dba7ea2e3dc82103bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:29Z,use_quota=True,user_id='78d224d06ff54fdca571c3056034ab45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Creating volume 40921404-bdc9-4664-8a02-bc791f75ae3c {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:43:30 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-40921404-bdc9-4664-8a02-bc791f75ae3c 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d090a5c3-2dd9-495d-9821-677aff32c2e4 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Acquiring lock "cinder-quobyte-ef9008f5-2554-452d-9b7e-3e5cde59a52b" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260467f3-a43e-4a25-911d-c2abd249e266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9526b00-0085-4379-a70a-c98c5b11dcec', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34088499-b401-4dd3-9d6f-4a20139ab18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:30 devstack sudo[101909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-40921404-bdc9-4664-8a02-bc791f75ae3c 1073741824
Nov 07 02:43:30 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d090a5c3-2dd9-495d-9821-677aff32c2e4 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Lock "cinder-quobyte-ef9008f5-2554-452d-9b7e-3e5cde59a52b" acquired by "delete_volume" :: waited 0.047s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:30 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Volume volume-f9526b00-0085-4379-a70a-c98c5b11dcec (f9526b00-0085-4379-a70a-c98c5b11dcec): created successfully
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34088499-b401-4dd3-9d6f-4a20139ab18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Flow 'volume_create_manager' (6fc3a685-4d98-478d-a396-f82a72165e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72ee141-0ab9-4e3b-a1de-b8b0bd44b702]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d090a5c3-2dd9-495d-9821-677aff32c2e4 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ef9008f5-2554-452d-9b7e-3e5cde59a52b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:30 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b55c9480-ded7-41c7-a5e3-ce46b7b50a40 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Created volume successfully.
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Flow 'volume_create_manager' (96d9409c-ed26-49e3-b914-14da25089d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ddca3ec-4a6c-45c0-b9cd-a2561a2630ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ddca3ec-4a6c-45c0-b9cd-a2561a2630ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2094616332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27927a21-2fc2-469c-af6a-95b705736a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b713629b63146dba7ea2e3dc82103bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:30Z,use_quota=True,user_id='78d224d06ff54fdca571c3056034ab45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d256b3f2-44a6-4619-ada9-500f4bd95442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d256b3f2-44a6-4619-ada9-500f4bd95442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1cfeb1-9d76-4ff8-825e-ecdb9d85eb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1cfeb1-9d76-4ff8-825e-ecdb9d85eb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27927a21-2fc2-469c-af6a-95b705736a6c', 'volume_name': 'volume-27927a21-2fc2-469c-af6a-95b705736a6c', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963dc970-74e7-452d-bf13-3baa64385831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963dc970-74e7-452d-bf13-3baa64385831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a33f98c-55a5-44fa-83dd-16e441bbd111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:30 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Volume 27927a21-2fc2-469c-af6a-95b705736a6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27927a21-2fc2-469c-af6a-95b705736a6c', 'volume_size': 1}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:30 devstack sudo[101911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ef9008f5-2554-452d-9b7e-3e5cde59a52b
Nov 07 02:43:30 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Flow 'volume_create_manager' (06926655-d946-499e-9a5a-7ac9666242e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9d6805-e1ac-4070-bb69-20858f86e9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9d6805-e1ac-4070-bb69-20858f86e9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1465464803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1088123b-769c-447b-888d-3e2fff31f2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b713629b63146dba7ea2e3dc82103bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:31Z,use_quota=True,user_id='78d224d06ff54fdca571c3056034ab45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d1f65b-2cb3-465a-9314-d08459952dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d1f65b-2cb3-465a-9314-d08459952dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a5fdea-0266-48c5-b9cf-a0a6e712b090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a5fdea-0266-48c5-b9cf-a0a6e712b090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1088123b-769c-447b-888d-3e2fff31f2fc', 'volume_name': 'volume-1088123b-769c-447b-888d-3e2fff31f2fc', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83663ff9-aa15-4a66-9080-abc1958939ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83663ff9-aa15-4a66-9080-abc1958939ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887bcc86-213f-4455-9ada-9278a859a182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:31 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Volume 1088123b-769c-447b-888d-3e2fff31f2fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1088123b-769c-447b-888d-3e2fff31f2fc', 'volume_size': 1}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:31 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d090a5c3-2dd9-495d-9821-677aff32c2e4 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ef9008f5-2554-452d-9b7e-3e5cde59a52b" returned: 0 in 0.527s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d090a5c3-2dd9-495d-9821-677aff32c2e4 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ef9008f5-2554-452d-9b7e-3e5cde59a52b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:31 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-40921404-bdc9-4664-8a02-bc791f75ae3c 1073741824" returned: 0 in 0.695s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:31 devstack sudo[101922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ef9008f5-2554-452d-9b7e-3e5cde59a52b
Nov 07 02:43:31 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-40921404-bdc9-4664-8a02-bc791f75ae3c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:31 devstack sudo[101924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-40921404-bdc9-4664-8a02-bc791f75ae3c
Nov 07 02:43:31 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:31 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d090a5c3-2dd9-495d-9821-677aff32c2e4 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ef9008f5-2554-452d-9b7e-3e5cde59a52b" returned: 0 in 0.274s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d090a5c3-2dd9-495d-9821-677aff32c2e4 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Lock "cinder-quobyte-ef9008f5-2554-452d-9b7e-3e5cde59a52b" released by "delete_volume" :: held 0.895s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:31 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-40921404-bdc9-4664-8a02-bc791f75ae3c" returned: 0 in 0.267s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.465s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1039816146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b98c5cf-ddf1-4121-9598-502d88df979c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b713629b63146dba7ea2e3dc82103bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:30Z,use_quota=True,user_id='78d224d06ff54fdca571c3056034ab45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Creating volume 4b98c5cf-ddf1-4121-9598-502d88df979c {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:43:31 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4b98c5cf-ddf1-4121-9598-502d88df979c 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8a1677-9836-4e20-b6b9-2352598654d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40921404-bdc9-4664-8a02-bc791f75ae3c', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b54f187-e002-4ca5-bd87-fcffd75864dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:31 devstack cinder-volume[87054]: WARNING cinder.quota [None req-d090a5c3-2dd9-495d-9821-677aff32c2e4 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:43:31 devstack sudo[101928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4b98c5cf-ddf1-4121-9598-502d88df979c 1073741824
Nov 07 02:43:31 devstack cinder-volume[87054]: WARNING cinder.quota [None req-d090a5c3-2dd9-495d-9821-677aff32c2e4 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:43:31 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:31 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Volume volume-40921404-bdc9-4664-8a02-bc791f75ae3c (40921404-bdc9-4664-8a02-bc791f75ae3c): created successfully
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b54f187-e002-4ca5-bd87-fcffd75864dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Flow 'volume_create_manager' (1935ec2d-f430-4671-a248-891b7026ebe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-d090a5c3-2dd9-495d-9821-677aff32c2e4 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Created reservations ['af8e15de-3a66-430e-9f40-279d5add2f9f', 'b5eebdd1-3ba0-4b47-8a99-7b801fe4a0ab', 'c96887ad-3694-4c1a-8867-629f821daf7c', 'c7c3e615-8f5f-4623-a10d-49b9a5473a6f'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:31 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-9d2226f7-8aea-4967-8f28-96571166cf9f tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Created volume successfully.
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d090a5c3-2dd9-495d-9821-677aff32c2e4 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d090a5c3-2dd9-495d-9821-677aff32c2e4 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d090a5c3-2dd9-495d-9821-677aff32c2e4 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d090a5c3-2dd9-495d-9821-677aff32c2e4 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d090a5c3-2dd9-495d-9821-677aff32c2e4 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d090a5c3-2dd9-495d-9821-677aff32c2e4 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:31 devstack sudo[101930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:43:31 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:31 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d090a5c3-2dd9-495d-9821-677aff32c2e4 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.293s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-d090a5c3-2dd9-495d-9821-677aff32c2e4 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:31 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-d090a5c3-2dd9-495d-9821-677aff32c2e4 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Deleted volume successfully.
Nov 07 02:43:31 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d090a5c3-2dd9-495d-9821-677aff32c2e4 tempest-VolumeRetypeWithoutMigrationTest-1448315273 None] Lock "cinder-ef9008f5-2554-452d-9b7e-3e5cde59a52b-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:31 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4b98c5cf-ddf1-4121-9598-502d88df979c 1073741824" returned: 0 in 0.556s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4b98c5cf-ddf1-4121-9598-502d88df979c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:32 devstack sudo[101936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4b98c5cf-ddf1-4121-9598-502d88df979c
Nov 07 02:43:32 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:32 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4b98c5cf-ddf1-4121-9598-502d88df979c" returned: 0 in 0.239s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:32 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.598s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:32 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2094616332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27927a21-2fc2-469c-af6a-95b705736a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b713629b63146dba7ea2e3dc82103bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:30Z,use_quota=True,user_id='78d224d06ff54fdca571c3056034ab45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:43:32 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Creating volume 27927a21-2fc2-469c-af6a-95b705736a6c {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:43:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:32 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:32 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:32 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:43:32 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:43:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-27927a21-2fc2-469c-af6a-95b705736a6c 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7c6f38-255f-4da0-98ff-bca1777eddc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b98c5cf-ddf1-4121-9598-502d88df979c', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:32 devstack sudo[101939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-27927a21-2fc2-469c-af6a-95b705736a6c 1073741824
Nov 07 02:43:32 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee1db34-7793-4837-a95b-12ad4143d316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:32 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Volume volume-4b98c5cf-ddf1-4121-9598-502d88df979c (4b98c5cf-ddf1-4121-9598-502d88df979c): created successfully
Nov 07 02:43:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee1db34-7793-4837-a95b-12ad4143d316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Flow 'volume_create_manager' (190e46dc-f90a-4924-9fcb-ed149857d115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:32 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-bd127a61-c4cc-4714-8e45-dcab21a7b805 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Created volume successfully.
Nov 07 02:43:32 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-27927a21-2fc2-469c-af6a-95b705736a6c 1073741824" returned: 0 in 0.532s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-27927a21-2fc2-469c-af6a-95b705736a6c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:32 devstack sudo[101945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-27927a21-2fc2-469c-af6a-95b705736a6c
Nov 07 02:43:32 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:33 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-27927a21-2fc2-469c-af6a-95b705736a6c" returned: 0 in 0.319s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.197s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1465464803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1088123b-769c-447b-888d-3e2fff31f2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b713629b63146dba7ea2e3dc82103bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:31Z,use_quota=True,user_id='78d224d06ff54fdca571c3056034ab45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:43:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Creating volume 1088123b-769c-447b-888d-3e2fff31f2fc {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:43:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:43:33 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:43:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1088123b-769c-447b-888d-3e2fff31f2fc 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:33 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a33f98c-55a5-44fa-83dd-16e441bbd111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27927a21-2fc2-469c-af6a-95b705736a6c', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:33 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1852e4af-ef67-484d-aee2-ee835d9ab373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:33 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Volume volume-27927a21-2fc2-469c-af6a-95b705736a6c (27927a21-2fc2-469c-af6a-95b705736a6c): created successfully
Nov 07 02:43:33 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1852e4af-ef67-484d-aee2-ee835d9ab373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:33 devstack sudo[101948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1088123b-769c-447b-888d-3e2fff31f2fc 1073741824
Nov 07 02:43:33 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:33 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Flow 'volume_create_manager' (96d9409c-ed26-49e3-b914-14da25089d77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:33 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-3c100e80-ba39-4c4e-adde-4a16db9a1b7a tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Created volume successfully.
Nov 07 02:43:33 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1088123b-769c-447b-888d-3e2fff31f2fc 1073741824" returned: 0 in 0.610s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1088123b-769c-447b-888d-3e2fff31f2fc {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:33 devstack sudo[101954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1088123b-769c-447b-888d-3e2fff31f2fc
Nov 07 02:43:33 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:34 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1088123b-769c-447b-888d-3e2fff31f2fc" returned: 0 in 0.262s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887bcc86-213f-4455-9ada-9278a859a182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1088123b-769c-447b-888d-3e2fff31f2fc', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78526fa5-abd6-47f6-b906-8048030a1a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:34 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Volume volume-1088123b-769c-447b-888d-3e2fff31f2fc (1088123b-769c-447b-888d-3e2fff31f2fc): created successfully
Nov 07 02:43:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78526fa5-abd6-47f6-b906-8048030a1a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Flow 'volume_create_manager' (06926655-d946-499e-9a5a-7ac9666242e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:34 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-3d8b92d4-d154-4510-9392-6b5be69aa3ec tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Created volume successfully.
Nov 07 02:43:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8d68ec94-0910-4d12-b114-0dd75273d7e5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "cinder-1088123b-769c-447b-888d-3e2fff31f2fc-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8d68ec94-0910-4d12-b114-0dd75273d7e5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-1088123b-769c-447b-888d-3e2fff31f2fc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8d68ec94-0910-4d12-b114-0dd75273d7e5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "cinder-quobyte-1088123b-769c-447b-888d-3e2fff31f2fc" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8d68ec94-0910-4d12-b114-0dd75273d7e5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-quobyte-1088123b-769c-447b-888d-3e2fff31f2fc" acquired by "delete_volume" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:34 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[24eca3f3-e20b-4186-89e4-eea43eaae872]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8d68ec94-0910-4d12-b114-0dd75273d7e5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1088123b-769c-447b-888d-3e2fff31f2fc {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:34 devstack sudo[101957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1088123b-769c-447b-888d-3e2fff31f2fc
Nov 07 02:43:34 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:35 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8d68ec94-0910-4d12-b114-0dd75273d7e5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1088123b-769c-447b-888d-3e2fff31f2fc" returned: 0 in 0.431s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8d68ec94-0910-4d12-b114-0dd75273d7e5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1088123b-769c-447b-888d-3e2fff31f2fc {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:35 devstack sudo[101962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1088123b-769c-447b-888d-3e2fff31f2fc
Nov 07 02:43:35 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:35 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8d68ec94-0910-4d12-b114-0dd75273d7e5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1088123b-769c-447b-888d-3e2fff31f2fc" returned: 0 in 0.293s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8d68ec94-0910-4d12-b114-0dd75273d7e5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-quobyte-1088123b-769c-447b-888d-3e2fff31f2fc" released by "delete_volume" :: held 0.796s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:35 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-8d68ec94-0910-4d12-b114-0dd75273d7e5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Created reservations ['e0af5fbc-8d80-4c39-877f-0421139f84d0', '262c7185-31bb-4de0-9fc1-94bf53e39fe0', 'cc3dec84-aba5-467b-976e-c53e08c0f4a0', '8212b659-f061-4b66-930c-5e9e99d00f43'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8d68ec94-0910-4d12-b114-0dd75273d7e5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8d68ec94-0910-4d12-b114-0dd75273d7e5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8d68ec94-0910-4d12-b114-0dd75273d7e5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8d68ec94-0910-4d12-b114-0dd75273d7e5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8d68ec94-0910-4d12-b114-0dd75273d7e5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8d68ec94-0910-4d12-b114-0dd75273d7e5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:35 devstack sudo[101965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:43:35 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3ac94092-ff97-4b1d-962e-26faf11d96ff tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "cinder-27927a21-2fc2-469c-af6a-95b705736a6c-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3ac94092-ff97-4b1d-962e-26faf11d96ff tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-27927a21-2fc2-469c-af6a-95b705736a6c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3ac94092-ff97-4b1d-962e-26faf11d96ff tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "cinder-quobyte-27927a21-2fc2-469c-af6a-95b705736a6c" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3ac94092-ff97-4b1d-962e-26faf11d96ff tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-quobyte-27927a21-2fc2-469c-af6a-95b705736a6c" acquired by "delete_volume" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:35 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8d68ec94-0910-4d12-b114-0dd75273d7e5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.322s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:35 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-8d68ec94-0910-4d12-b114-0dd75273d7e5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:35 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-8d68ec94-0910-4d12-b114-0dd75273d7e5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Deleted volume successfully.
Nov 07 02:43:35 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae355b7-8181-44d3-8496-ca846356ec13]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3ac94092-ff97-4b1d-962e-26faf11d96ff tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-27927a21-2fc2-469c-af6a-95b705736a6c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8d68ec94-0910-4d12-b114-0dd75273d7e5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-1088123b-769c-447b-888d-3e2fff31f2fc-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:35 devstack sudo[101968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-27927a21-2fc2-469c-af6a-95b705736a6c
Nov 07 02:43:35 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:36 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3ac94092-ff97-4b1d-962e-26faf11d96ff tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-27927a21-2fc2-469c-af6a-95b705736a6c" returned: 0 in 0.407s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3ac94092-ff97-4b1d-962e-26faf11d96ff tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-27927a21-2fc2-469c-af6a-95b705736a6c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:36 devstack sudo[101973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-27927a21-2fc2-469c-af6a-95b705736a6c
Nov 07 02:43:36 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:36 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3ac94092-ff97-4b1d-962e-26faf11d96ff tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-27927a21-2fc2-469c-af6a-95b705736a6c" returned: 0 in 0.261s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3ac94092-ff97-4b1d-962e-26faf11d96ff tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-quobyte-27927a21-2fc2-469c-af6a-95b705736a6c" released by "delete_volume" :: held 0.732s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:36 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-3ac94092-ff97-4b1d-962e-26faf11d96ff tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Created reservations ['67baed9b-710f-4b9b-9952-e2c643214e46', '0292c0ca-22b6-4a12-99b5-d97027604179', 'ad6e13c0-af27-45f3-83f4-8a86bfbc387e', 'd170ca1d-503a-4be8-aa76-4a98a88b6acc'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3ac94092-ff97-4b1d-962e-26faf11d96ff tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3ac94092-ff97-4b1d-962e-26faf11d96ff tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3ac94092-ff97-4b1d-962e-26faf11d96ff tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3ac94092-ff97-4b1d-962e-26faf11d96ff tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3ac94092-ff97-4b1d-962e-26faf11d96ff tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3ac94092-ff97-4b1d-962e-26faf11d96ff tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:36 devstack sudo[101976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:43:36 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f8ef69dd-9bd0-4245-aa53-1fc5aeaa74c5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "cinder-4b98c5cf-ddf1-4121-9598-502d88df979c-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f8ef69dd-9bd0-4245-aa53-1fc5aeaa74c5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-4b98c5cf-ddf1-4121-9598-502d88df979c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f8ef69dd-9bd0-4245-aa53-1fc5aeaa74c5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "cinder-quobyte-4b98c5cf-ddf1-4121-9598-502d88df979c" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f8ef69dd-9bd0-4245-aa53-1fc5aeaa74c5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-quobyte-4b98c5cf-ddf1-4121-9598-502d88df979c" acquired by "delete_volume" :: waited 0.024s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:37 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3ac94092-ff97-4b1d-962e-26faf11d96ff tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.394s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:37 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-3ac94092-ff97-4b1d-962e-26faf11d96ff tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:37 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-3ac94092-ff97-4b1d-962e-26faf11d96ff tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Deleted volume successfully.
Nov 07 02:43:37 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[f624bd7e-76f1-4bf1-b2d4-219fbe0dab49]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f8ef69dd-9bd0-4245-aa53-1fc5aeaa74c5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4b98c5cf-ddf1-4121-9598-502d88df979c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3ac94092-ff97-4b1d-962e-26faf11d96ff tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-27927a21-2fc2-469c-af6a-95b705736a6c-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:37 devstack sudo[101979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4b98c5cf-ddf1-4121-9598-502d88df979c
Nov 07 02:43:37 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:37 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f8ef69dd-9bd0-4245-aa53-1fc5aeaa74c5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4b98c5cf-ddf1-4121-9598-502d88df979c" returned: 0 in 0.437s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f8ef69dd-9bd0-4245-aa53-1fc5aeaa74c5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4b98c5cf-ddf1-4121-9598-502d88df979c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:37 devstack sudo[101984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4b98c5cf-ddf1-4121-9598-502d88df979c
Nov 07 02:43:37 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:37 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f8ef69dd-9bd0-4245-aa53-1fc5aeaa74c5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4b98c5cf-ddf1-4121-9598-502d88df979c" returned: 0 in 0.293s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f8ef69dd-9bd0-4245-aa53-1fc5aeaa74c5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-quobyte-4b98c5cf-ddf1-4121-9598-502d88df979c" released by "delete_volume" :: held 0.790s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:37 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-f8ef69dd-9bd0-4245-aa53-1fc5aeaa74c5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Created reservations ['10bec23a-f7d8-4119-9854-89f2346bfb0e', '2a1e4640-5992-4492-ba54-799323707ef7', '7ecde63d-5611-4f9d-9550-02e039fb500c', '9d137baa-5beb-4708-9124-b0e62d964de7'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f8ef69dd-9bd0-4245-aa53-1fc5aeaa74c5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f8ef69dd-9bd0-4245-aa53-1fc5aeaa74c5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:37 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef69dd-9bd0-4245-aa53-1fc5aeaa74c5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef69dd-9bd0-4245-aa53-1fc5aeaa74c5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f8ef69dd-9bd0-4245-aa53-1fc5aeaa74c5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f8ef69dd-9bd0-4245-aa53-1fc5aeaa74c5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:38 devstack sudo[101988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:43:38 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f170378d-4d97-4f7c-9fd4-9f1f57accfd8 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "cinder-40921404-bdc9-4664-8a02-bc791f75ae3c-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f170378d-4d97-4f7c-9fd4-9f1f57accfd8 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-40921404-bdc9-4664-8a02-bc791f75ae3c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f170378d-4d97-4f7c-9fd4-9f1f57accfd8 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "cinder-quobyte-40921404-bdc9-4664-8a02-bc791f75ae3c" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:43:38 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Flow 'volume_create_manager' (659a5e27-caea-44a3-a7c0-68819b4e0a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (511717de-03b1-4f17-9ab1-368d194a2364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f8ef69dd-9bd0-4245-aa53-1fc5aeaa74c5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.435s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-f8ef69dd-9bd0-4245-aa53-1fc5aeaa74c5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f170378d-4d97-4f7c-9fd4-9f1f57accfd8 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-quobyte-40921404-bdc9-4664-8a02-bc791f75ae3c" acquired by "delete_volume" :: waited 0.072s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (511717de-03b1-4f17-9ab1-368d194a2364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-92268213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=617dd0ff-f734-4e0d-bc39-f2e3a9813b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6618eafeb041ce9cd2c43aa57f5072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:38Z,use_quota=True,user_id='33f012e1f4c94364b2ab543205feae8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6776b9ac-74f9-4d7c-82d8-4d6ec864b75b),volume_type_id=6776b9ac-74f9-4d7c-82d8-4d6ec864b75b)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3c5604-5b19-4d19-939c-1abe66ca777b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3c5604-5b19-4d19-939c-1abe66ca777b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5469dba-a922-4dd1-b15b-5fef76e4c760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5469dba-a922-4dd1-b15b-5fef76e4c760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '617dd0ff-f734-4e0d-bc39-f2e3a9813b97', 'volume_name': 'volume-617dd0ff-f734-4e0d-bc39-f2e3a9813b97', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89acf005-9ba7-4a71-95c6-7bd1205857b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89acf005-9ba7-4a71-95c6-7bd1205857b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d4363d-0620-41a1-9e59-6c8e69e8f231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:38 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Volume 617dd0ff-f734-4e0d-bc39-f2e3a9813b97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-617dd0ff-f734-4e0d-bc39-f2e3a9813b97', 'volume_size': 1}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-92268213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=617dd0ff-f734-4e0d-bc39-f2e3a9813b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6618eafeb041ce9cd2c43aa57f5072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:38Z,use_quota=True,user_id='33f012e1f4c94364b2ab543205feae8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6776b9ac-74f9-4d7c-82d8-4d6ec864b75b),volume_type_id=6776b9ac-74f9-4d7c-82d8-4d6ec864b75b)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Creating volume 617dd0ff-f734-4e0d-bc39-f2e3a9813b97 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:43:38 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-617dd0ff-f734-4e0d-bc39-f2e3a9813b97 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b83c369-e7de-4be3-92f8-d5b58236f8cc]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f170378d-4d97-4f7c-9fd4-9f1f57accfd8 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-40921404-bdc9-4664-8a02-bc791f75ae3c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:38 devstack sudo[101991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-617dd0ff-f734-4e0d-bc39-f2e3a9813b97 1073741824
Nov 07 02:43:38 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:38 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f8ef69dd-9bd0-4245-aa53-1fc5aeaa74c5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Deleted volume successfully.
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f8ef69dd-9bd0-4245-aa53-1fc5aeaa74c5 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-4b98c5cf-ddf1-4121-9598-502d88df979c-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:38 devstack sudo[101992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-40921404-bdc9-4664-8a02-bc791f75ae3c
Nov 07 02:43:38 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Flow 'volume_create_manager' (df1e9c0b-1fcc-433d-8192-12afdae2a969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0065d95-8677-4176-a443-7ad456fc7805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0065d95-8677-4176-a443-7ad456fc7805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-895373003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbcff9e6-24cd-4dc9-adc6-05d7317e26aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6618eafeb041ce9cd2c43aa57f5072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:39Z,use_quota=True,user_id='33f012e1f4c94364b2ab543205feae8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76623091-ed77-47ea-99b4-9062df23580f),volume_type_id=76623091-ed77-47ea-99b4-9062df23580f)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb216bc2-aa93-4a32-85f5-85c4610d6753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb216bc2-aa93-4a32-85f5-85c4610d6753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (663c436b-2fcf-4297-8823-a876b6c4fc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (663c436b-2fcf-4297-8823-a876b6c4fc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbcff9e6-24cd-4dc9-adc6-05d7317e26aa', 'volume_name': 'volume-dbcff9e6-24cd-4dc9-adc6-05d7317e26aa', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e729ff-0bfc-4110-a0ab-791f7ad55660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e729ff-0bfc-4110-a0ab-791f7ad55660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7511842a-dea0-46e0-9706-5d3ba59cfa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:38 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Volume dbcff9e6-24cd-4dc9-adc6-05d7317e26aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbcff9e6-24cd-4dc9-adc6-05d7317e26aa', 'volume_size': 1}
Nov 07 02:43:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:39 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f170378d-4d97-4f7c-9fd4-9f1f57accfd8 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-40921404-bdc9-4664-8a02-bc791f75ae3c" returned: 0 in 0.520s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f170378d-4d97-4f7c-9fd4-9f1f57accfd8 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-40921404-bdc9-4664-8a02-bc791f75ae3c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:39 devstack sudo[102002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-40921404-bdc9-4664-8a02-bc791f75ae3c
Nov 07 02:43:39 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:39 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-617dd0ff-f734-4e0d-bc39-f2e3a9813b97 1073741824" returned: 0 in 0.621s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-617dd0ff-f734-4e0d-bc39-f2e3a9813b97 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:39 devstack sudo[102005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-617dd0ff-f734-4e0d-bc39-f2e3a9813b97
Nov 07 02:43:39 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:39 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f170378d-4d97-4f7c-9fd4-9f1f57accfd8 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-40921404-bdc9-4664-8a02-bc791f75ae3c" returned: 0 in 0.333s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f170378d-4d97-4f7c-9fd4-9f1f57accfd8 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-quobyte-40921404-bdc9-4664-8a02-bc791f75ae3c" released by "delete_volume" :: held 0.981s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:39 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-617dd0ff-f734-4e0d-bc39-f2e3a9813b97" returned: 0 in 0.292s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.579s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-895373003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbcff9e6-24cd-4dc9-adc6-05d7317e26aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6618eafeb041ce9cd2c43aa57f5072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:39Z,use_quota=True,user_id='33f012e1f4c94364b2ab543205feae8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76623091-ed77-47ea-99b4-9062df23580f),volume_type_id=76623091-ed77-47ea-99b4-9062df23580f)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Creating volume dbcff9e6-24cd-4dc9-adc6-05d7317e26aa {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:43:39 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dbcff9e6-24cd-4dc9-adc6-05d7317e26aa 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-f170378d-4d97-4f7c-9fd4-9f1f57accfd8 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Created reservations ['abc66909-f11d-4107-a3c3-751aa9fe1f1a', 'b8ba9917-4172-4dbc-b7bb-6c548caac28f', 'f428f804-1a99-4b90-a811-3e6ab5d9448d', '01091242-12ce-4a84-b4e7-ed751a2cc382'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:39 devstack sudo[102009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dbcff9e6-24cd-4dc9-adc6-05d7317e26aa 1073741824
Nov 07 02:43:39 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d4363d-0620-41a1-9e59-6c8e69e8f231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-617dd0ff-f734-4e0d-bc39-f2e3a9813b97', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d2de7c-546a-4072-b155-28d8be6be663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:39 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Volume volume-617dd0ff-f734-4e0d-bc39-f2e3a9813b97 (617dd0ff-f734-4e0d-bc39-f2e3a9813b97): created successfully
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d2de7c-546a-4072-b155-28d8be6be663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Flow 'volume_create_manager' (659a5e27-caea-44a3-a7c0-68819b4e0a19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:39 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-5f722904-104c-495e-9d61-09dc9dd61a4e tempest-TestInstancesWithCinderVolumes-710842639 None] Created volume successfully.
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f170378d-4d97-4f7c-9fd4-9f1f57accfd8 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f170378d-4d97-4f7c-9fd4-9f1f57accfd8 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f170378d-4d97-4f7c-9fd4-9f1f57accfd8 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f170378d-4d97-4f7c-9fd4-9f1f57accfd8 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f170378d-4d97-4f7c-9fd4-9f1f57accfd8 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f170378d-4d97-4f7c-9fd4-9f1f57accfd8 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:39 devstack sudo[102011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:43:39 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-afd4beb4-7e71-4e00-9224-4249c9900e46 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "cinder-f9526b00-0085-4379-a70a-c98c5b11dcec-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:39 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-afd4beb4-7e71-4e00-9224-4249c9900e46 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-f9526b00-0085-4379-a70a-c98c5b11dcec-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Flow 'volume_create_manager' (77d837a8-3bcd-4df8-a571-43cddf65ee21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b87e8d9-1809-4146-a92c-29b8c6931630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b87e8d9-1809-4146-a92c-29b8c6931630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-912788416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e6337d-4476-4455-baae-2e91276589af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6618eafeb041ce9cd2c43aa57f5072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:40Z,use_quota=True,user_id='33f012e1f4c94364b2ab543205feae8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a659f801-5736-42f2-9791-8c026670e846),volume_type_id=a659f801-5736-42f2-9791-8c026670e846)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15377304-911e-4345-85af-242a2b573a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15377304-911e-4345-85af-242a2b573a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c67a247-5a6b-477d-bf87-32bd21fcc762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.image.glance [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Creating Keystone auth plugin from conf {{(pid=87054) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-afd4beb4-7e71-4e00-9224-4249c9900e46 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "cinder-quobyte-f9526b00-0085-4379-a70a-c98c5b11dcec" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:40 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-afd4beb4-7e71-4e00-9224-4249c9900e46 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-quobyte-f9526b00-0085-4379-a70a-c98c5b11dcec" acquired by "delete_volume" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f170378d-4d97-4f7c-9fd4-9f1f57accfd8 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.405s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-f170378d-4d97-4f7c-9fd4-9f1f57accfd8 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:40 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f170378d-4d97-4f7c-9fd4-9f1f57accfd8 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Deleted volume successfully.
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab762cf-e1eb-4a51-a178-683f1fd45e25]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-afd4beb4-7e71-4e00-9224-4249c9900e46 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f9526b00-0085-4379-a70a-c98c5b11dcec {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:40 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f170378d-4d97-4f7c-9fd4-9f1f57accfd8 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-40921404-bdc9-4664-8a02-bc791f75ae3c-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dbcff9e6-24cd-4dc9-adc6-05d7317e26aa 1073741824" returned: 0 in 0.753s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Flow 'volume_create_manager' (51bdb3d0-fe23-4d4d-a1d2-95e93cbfce10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3681c7fc-5b6e-4041-899e-8c7e88a713bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3681c7fc-5b6e-4041-899e-8c7e88a713bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1187137932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46b3694-bca0-479c-a149-6ee5793fb305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc0ab630860241a2a7118123fa7338a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:40Z,use_quota=True,user_id='a9b8fedf4862401caae731d8e5d359fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ff9d26-7ade-4306-81d9-a47f1ac5e709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ff9d26-7ade-4306-81d9-a47f1ac5e709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c64ed1df-c313-493a-899f-540779802186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c64ed1df-c313-493a-899f-540779802186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f46b3694-bca0-479c-a149-6ee5793fb305', 'volume_name': 'volume-f46b3694-bca0-479c-a149-6ee5793fb305', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58750fa4-64c4-4e86-8ce7-f24f3d09643a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58750fa4-64c4-4e86-8ce7-f24f3d09643a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:40 devstack sudo[102018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f9526b00-0085-4379-a70a-c98c5b11dcec
Nov 07 02:43:40 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58786751-bde1-4262-a3ef-94273a6d7191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:40 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Volume f46b3694-bca0-479c-a149-6ee5793fb305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f46b3694-bca0-479c-a149-6ee5793fb305', 'volume_size': 1}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dbcff9e6-24cd-4dc9-adc6-05d7317e26aa {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:40 devstack sudo[102020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dbcff9e6-24cd-4dc9-adc6-05d7317e26aa
Nov 07 02:43:40 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c67a247-5a6b-477d-bf87-32bd21fcc762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd0e6337d-4476-4455-baae-2e91276589af', 'volume_name': 'volume-d0e6337d-4476-4455-baae-2e91276589af', 'volume_size': 1, 'image_id': '4b3732d6-4f33-40a6-8a27-8de5e57b728c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b3732d6-4f33-40a6-8a27-8de5e57b728c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--899446521', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f6618eafeb041ce9cd2c43aa57f5072', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b3732d6-4f33-40a6-8a27-8de5e57b728c', 'created_at': datetime.datetime(2026, 11, 7, 1, 43, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 43, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b3732d6-4f33-40a6-8a27-8de5e57b728c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x721709ef7b90>}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053d0ed2-72c5-4219-bada-5ff1365cca49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053d0ed2-72c5-4219-bada-5ff1365cca49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5708a204-eb9d-4cb5-9f5c-069d6e469155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:40 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Volume d0e6337d-4476-4455-baae-2e91276589af: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d0e6337d-4476-4455-baae-2e91276589af', 'volume_size': 1, 'image_id': '4b3732d6-4f33-40a6-8a27-8de5e57b728c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b3732d6-4f33-40a6-8a27-8de5e57b728c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--899446521', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f6618eafeb041ce9cd2c43aa57f5072', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b3732d6-4f33-40a6-8a27-8de5e57b728c', 'created_at': datetime.datetime(2026, 11, 7, 1, 43, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 43, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b3732d6-4f33-40a6-8a27-8de5e57b728c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x721709ef7b90>}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Trying to clone d0e6337d-4476-4455-baae-2e91276589af from image 4b3732d6-4f33-40a6-8a27-8de5e57b728c at location (None, [{'url': 'file:///opt/stack/data/glance/images/4b3732d6-4f33-40a6-8a27-8de5e57b728c', 'metadata': {}}]). {{(pid=87054) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 07 02:43:40 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-afd4beb4-7e71-4e00-9224-4249c9900e46 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f9526b00-0085-4379-a70a-c98c5b11dcec" returned: 0 in 0.420s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-afd4beb4-7e71-4e00-9224-4249c9900e46 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f9526b00-0085-4379-a70a-c98c5b11dcec {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:40 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dbcff9e6-24cd-4dc9-adc6-05d7317e26aa" returned: 0 in 0.284s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:40 devstack sudo[102026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f9526b00-0085-4379-a70a-c98c5b11dcec
Nov 07 02:43:40 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.308s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1187137932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46b3694-bca0-479c-a149-6ee5793fb305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc0ab630860241a2a7118123fa7338a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:40Z,use_quota=True,user_id='a9b8fedf4862401caae731d8e5d359fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Creating volume f46b3694-bca0-479c-a149-6ee5793fb305 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:43:40 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f46b3694-bca0-479c-a149-6ee5793fb305 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:40 devstack sudo[102028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f46b3694-bca0-479c-a149-6ee5793fb305 1073741824
Nov 07 02:43:40 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7511842a-dea0-46e0-9706-5d3ba59cfa14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbcff9e6-24cd-4dc9-adc6-05d7317e26aa', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ea05cd-dadf-447e-ba60-a82abfe00232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:40 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Volume volume-dbcff9e6-24cd-4dc9-adc6-05d7317e26aa (dbcff9e6-24cd-4dc9-adc6-05d7317e26aa): created successfully
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ea05cd-dadf-447e-ba60-a82abfe00232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Flow 'volume_create_manager' (df1e9c0b-1fcc-433d-8192-12afdae2a969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:40 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-300a8194-b2af-4522-9f6a-fd690d6c3747 tempest-TestInstancesWithCinderVolumes-710842639 None] Created volume successfully.
Nov 07 02:43:40 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-afd4beb4-7e71-4e00-9224-4249c9900e46 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f9526b00-0085-4379-a70a-c98c5b11dcec" returned: 0 in 0.269s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:40 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-afd4beb4-7e71-4e00-9224-4249c9900e46 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-quobyte-f9526b00-0085-4379-a70a-c98c5b11dcec" released by "delete_volume" :: held 0.760s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:41 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-afd4beb4-7e71-4e00-9224-4249c9900e46 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Created reservations ['4dcd858e-d008-4a68-90af-6c9486428e76', '03d156b4-f400-4d2f-8c7e-e833c4aeaa09', '3e7a43f7-7b52-45ca-9aa6-a796f02c198e', '1f55f67b-a457-49a1-9e09-1eee33be3646'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-afd4beb4-7e71-4e00-9224-4249c9900e46 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-afd4beb4-7e71-4e00-9224-4249c9900e46 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-afd4beb4-7e71-4e00-9224-4249c9900e46 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-afd4beb4-7e71-4e00-9224-4249c9900e46 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-afd4beb4-7e71-4e00-9224-4249c9900e46 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-afd4beb4-7e71-4e00-9224-4249c9900e46 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:41 devstack sudo[102035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:43:41 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:41 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f46b3694-bca0-479c-a149-6ee5793fb305 1073741824" returned: 0 in 0.537s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f46b3694-bca0-479c-a149-6ee5793fb305 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:41 devstack sudo[102037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f46b3694-bca0-479c-a149-6ee5793fb305
Nov 07 02:43:41 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:41 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-afd4beb4-7e71-4e00-9224-4249c9900e46 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.281s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:41 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-afd4beb4-7e71-4e00-9224-4249c9900e46 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:41 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-afd4beb4-7e71-4e00-9224-4249c9900e46 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Deleted volume successfully.
Nov 07 02:43:41 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-afd4beb4-7e71-4e00-9224-4249c9900e46 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-f9526b00-0085-4379-a70a-c98c5b11dcec-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:41 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f46b3694-bca0-479c-a149-6ee5793fb305" returned: 0 in 0.260s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:41 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58786751-bde1-4262-a3ef-94273a6d7191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f46b3694-bca0-479c-a149-6ee5793fb305', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:41 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df492ab6-cf4c-4688-9f9d-77727fe49699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:41 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Volume volume-f46b3694-bca0-479c-a149-6ee5793fb305 (f46b3694-bca0-479c-a149-6ee5793fb305): created successfully
Nov 07 02:43:41 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df492ab6-cf4c-4688-9f9d-77727fe49699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:41 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Flow 'volume_create_manager' (51bdb3d0-fe23-4d4d-a1d2-95e93cbfce10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:41 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f6060de9-f170-4c1d-adc8-dbd191c06d6d tempest-VolumesServicesTestJSON-75555506 None] Created volume successfully.
Nov 07 02:43:42 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-382dec61-12b7-480e-a535-2cdd01e08327 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "cinder-76b3a36f-2b26-4112-b6b5-87f15ff82112-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:42 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-382dec61-12b7-480e-a535-2cdd01e08327 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-76b3a36f-2b26-4112-b6b5-87f15ff82112-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:42 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-382dec61-12b7-480e-a535-2cdd01e08327 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "cinder-quobyte-76b3a36f-2b26-4112-b6b5-87f15ff82112" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:42 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-382dec61-12b7-480e-a535-2cdd01e08327 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-quobyte-76b3a36f-2b26-4112-b6b5-87f15ff82112" acquired by "delete_volume" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:42 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[990794c2-7143-4cbe-8f9c-cd9f978d81bc]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-382dec61-12b7-480e-a535-2cdd01e08327 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-76b3a36f-2b26-4112-b6b5-87f15ff82112 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:42 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-10cf00f6-dbc6-49c3-b81f-e149b7ee54d0 tempest-VolumesServicesTestJSON-75555506 None] Acquiring lock "cinder-f46b3694-bca0-479c-a149-6ee5793fb305-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:42 devstack sudo[102043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-76b3a36f-2b26-4112-b6b5-87f15ff82112
Nov 07 02:43:42 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:42 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-10cf00f6-dbc6-49c3-b81f-e149b7ee54d0 tempest-VolumesServicesTestJSON-75555506 None] Lock "cinder-f46b3694-bca0-479c-a149-6ee5793fb305-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:42 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-10cf00f6-dbc6-49c3-b81f-e149b7ee54d0 tempest-VolumesServicesTestJSON-75555506 None] Acquiring lock "cinder-quobyte-f46b3694-bca0-479c-a149-6ee5793fb305" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:42 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-10cf00f6-dbc6-49c3-b81f-e149b7ee54d0 tempest-VolumesServicesTestJSON-75555506 None] Lock "cinder-quobyte-f46b3694-bca0-479c-a149-6ee5793fb305" acquired by "delete_volume" :: waited 0.021s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:42 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7c73a1-5b9b-42d2-8a61-82dd1b5caa8f]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-10cf00f6-dbc6-49c3-b81f-e149b7ee54d0 tempest-VolumesServicesTestJSON-75555506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f46b3694-bca0-479c-a149-6ee5793fb305 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:42 devstack sudo[102045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f46b3694-bca0-479c-a149-6ee5793fb305
Nov 07 02:43:42 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:42 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-382dec61-12b7-480e-a535-2cdd01e08327 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-76b3a36f-2b26-4112-b6b5-87f15ff82112" returned: 0 in 0.425s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-382dec61-12b7-480e-a535-2cdd01e08327 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-76b3a36f-2b26-4112-b6b5-87f15ff82112 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:42 devstack sudo[102050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-76b3a36f-2b26-4112-b6b5-87f15ff82112
Nov 07 02:43:42 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:42 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-10cf00f6-dbc6-49c3-b81f-e149b7ee54d0 tempest-VolumesServicesTestJSON-75555506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f46b3694-bca0-479c-a149-6ee5793fb305" returned: 0 in 0.387s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-10cf00f6-dbc6-49c3-b81f-e149b7ee54d0 tempest-VolumesServicesTestJSON-75555506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f46b3694-bca0-479c-a149-6ee5793fb305 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:42 devstack sudo[102055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f46b3694-bca0-479c-a149-6ee5793fb305
Nov 07 02:43:42 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:43 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-382dec61-12b7-480e-a535-2cdd01e08327 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-76b3a36f-2b26-4112-b6b5-87f15ff82112" returned: 0 in 0.293s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-382dec61-12b7-480e-a535-2cdd01e08327 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-quobyte-76b3a36f-2b26-4112-b6b5-87f15ff82112" released by "delete_volume" :: held 0.776s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-382dec61-12b7-480e-a535-2cdd01e08327 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Created reservations ['4488b5d2-408e-4f46-ac3d-6fc9d2ff9238', '2a505be7-4837-4fd9-9389-77fa1c87010f', '7513981f-b117-44ff-b86a-a0f1cba67efd', '752539a3-7a15-40ef-962d-1aa91ff4868d'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-382dec61-12b7-480e-a535-2cdd01e08327 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-382dec61-12b7-480e-a535-2cdd01e08327 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-382dec61-12b7-480e-a535-2cdd01e08327 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-382dec61-12b7-480e-a535-2cdd01e08327 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-382dec61-12b7-480e-a535-2cdd01e08327 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-382dec61-12b7-480e-a535-2cdd01e08327 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:43 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-10cf00f6-dbc6-49c3-b81f-e149b7ee54d0 tempest-VolumesServicesTestJSON-75555506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f46b3694-bca0-479c-a149-6ee5793fb305" returned: 0 in 0.292s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:43 devstack sudo[102059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:43:43 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-10cf00f6-dbc6-49c3-b81f-e149b7ee54d0 tempest-VolumesServicesTestJSON-75555506 None] Lock "cinder-quobyte-f46b3694-bca0-479c-a149-6ee5793fb305" released by "delete_volume" :: held 0.733s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-10cf00f6-dbc6-49c3-b81f-e149b7ee54d0 tempest-VolumesServicesTestJSON-75555506 None] Created reservations ['ef61e0cb-8c79-416b-b72a-843f73eea6eb', '75bdf423-337a-4aa9-84fc-647121f584f7', 'da995a69-e66f-4274-9b63-1be30baeda56', '7e2c186a-bc3f-45ce-8dc0-447136cf8b93'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-10cf00f6-dbc6-49c3-b81f-e149b7ee54d0 tempest-VolumesServicesTestJSON-75555506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-10cf00f6-dbc6-49c3-b81f-e149b7ee54d0 tempest-VolumesServicesTestJSON-75555506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-10cf00f6-dbc6-49c3-b81f-e149b7ee54d0 tempest-VolumesServicesTestJSON-75555506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-10cf00f6-dbc6-49c3-b81f-e149b7ee54d0 tempest-VolumesServicesTestJSON-75555506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-10cf00f6-dbc6-49c3-b81f-e149b7ee54d0 tempest-VolumesServicesTestJSON-75555506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-10cf00f6-dbc6-49c3-b81f-e149b7ee54d0 tempest-VolumesServicesTestJSON-75555506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:43 devstack sudo[102061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:43:43 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:43 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-382dec61-12b7-480e-a535-2cdd01e08327 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.302s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-382dec61-12b7-480e-a535-2cdd01e08327 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:43 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-382dec61-12b7-480e-a535-2cdd01e08327 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Deleted volume successfully.
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-382dec61-12b7-480e-a535-2cdd01e08327 tempest-CreateVolumesFromSourceVolumeTest-581757698 None] Lock "cinder-76b3a36f-2b26-4112-b6b5-87f15ff82112-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:43 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-10cf00f6-dbc6-49c3-b81f-e149b7ee54d0 tempest-VolumesServicesTestJSON-75555506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.319s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-10cf00f6-dbc6-49c3-b81f-e149b7ee54d0 tempest-VolumesServicesTestJSON-75555506 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:43 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-10cf00f6-dbc6-49c3-b81f-e149b7ee54d0 tempest-VolumesServicesTestJSON-75555506 None] Deleted volume successfully.
Nov 07 02:43:43 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-10cf00f6-dbc6-49c3-b81f-e149b7ee54d0 tempest-VolumesServicesTestJSON-75555506 None] Lock "cinder-f46b3694-bca0-479c-a149-6ee5793fb305-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:44 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4b3732d6-4f33-40a6-8a27-8de5e57b728c_52juuvktdevstack@QuobyteHD, size 20.69 MB, duration 4.26 sec {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 07 02:43:44 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Image download 20.69 MB at 4.85 MB/s
Nov 07 02:43:44 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7875f1a-2e27-488b-ab40-b14751b5528c]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b3732d6-4f33-40a6-8a27-8de5e57b728c_52juuvktdevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:44 devstack sudo[102066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b3732d6-4f33-40a6-8a27-8de5e57b728c_52juuvktdevstack@QuobyteHD
Nov 07 02:43:44 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:45 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b3732d6-4f33-40a6-8a27-8de5e57b728c_52juuvktdevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:45 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Temporary image 4b3732d6-4f33-40a6-8a27-8de5e57b728c is fetched for user 33f012e1f4c94364b2ab543205feae8f. {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 07 02:43:45 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[c815f594-8afc-4d67-83c4-6bbf34174337]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b3732d6-4f33-40a6-8a27-8de5e57b728c_52juuvktdevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:45 devstack sudo[102072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b3732d6-4f33-40a6-8a27-8de5e57b728c_52juuvktdevstack@QuobyteHD
Nov 07 02:43:45 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:45 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b3732d6-4f33-40a6-8a27-8de5e57b728c_52juuvktdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-912788416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e6337d-4476-4455-baae-2e91276589af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6618eafeb041ce9cd2c43aa57f5072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:40Z,use_quota=True,user_id='33f012e1f4c94364b2ab543205feae8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a659f801-5736-42f2-9791-8c026670e846),volume_type_id=a659f801-5736-42f2-9791-8c026670e846)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:43:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Creating volume d0e6337d-4476-4455-baae-2e91276589af {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:43:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:43:45 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:43:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0e6337d-4476-4455-baae-2e91276589af 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:45 devstack sudo[102077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0e6337d-4476-4455-baae-2e91276589af 1073741824
Nov 07 02:43:45 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:46 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0e6337d-4476-4455-baae-2e91276589af 1073741824" returned: 0 in 0.536s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0e6337d-4476-4455-baae-2e91276589af {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:46 devstack sudo[102083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0e6337d-4476-4455-baae-2e91276589af
Nov 07 02:43:46 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:46 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0e6337d-4476-4455-baae-2e91276589af" returned: 0 in 0.272s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:46 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Attempting download of 4b3732d6-4f33-40a6-8a27-8de5e57b728c ((None, [{'url': 'file:///opt/stack/data/glance/images/4b3732d6-4f33-40a6-8a27-8de5e57b728c', 'metadata': {}}])) to volume d0e6337d-4476-4455-baae-2e91276589af. {{(pid=87054) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 07 02:43:46 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f657509-fb2d-487e-95b0-1a490cd6802e]: (4, 'raw') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b3732d6-4f33-40a6-8a27-8de5e57b728c_rjk5hbx8 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:46 devstack sudo[102086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b3732d6-4f33-40a6-8a27-8de5e57b728c_rjk5hbx8
Nov 07 02:43:46 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:47 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b3732d6-4f33-40a6-8a27-8de5e57b728c_rjk5hbx8" returned: 0 in 0.386s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b3732d6-4f33-40a6-8a27-8de5e57b728c_rjk5hbx8 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:47 devstack sudo[102090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b3732d6-4f33-40a6-8a27-8de5e57b728c_rjk5hbx8
Nov 07 02:43:47 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:47 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b3732d6-4f33-40a6-8a27-8de5e57b728c_rjk5hbx8" returned: 1 in 0.385s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b3732d6-4f33-40a6-8a27-8de5e57b728c_rjk5hbx8' failed. Not Retrying. {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:43:47 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3bcf91-9c8b-468f-8b03-9660ef65a182]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b3732d6-4f33-40a6-8a27-8de5e57b728c_52juuvktdevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:47 devstack sudo[102094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b3732d6-4f33-40a6-8a27-8de5e57b728c_52juuvktdevstack@QuobyteHD
Nov 07 02:43:47 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:47 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b3732d6-4f33-40a6-8a27-8de5e57b728c_52juuvktdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:47 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] 4b3732d6-4f33-40a6-8a27-8de5e57b728c was qcow2, converting to qcow2 {{(pid=87054) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 07 02:43:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b3732d6-4f33-40a6-8a27-8de5e57b728c_52juuvktdevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0e6337d-4476-4455-baae-2e91276589af {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:47 devstack sudo[102099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b3732d6-4f33-40a6-8a27-8de5e57b728c_52juuvktdevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0e6337d-4476-4455-baae-2e91276589af
Nov 07 02:43:47 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:49 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Flow 'volume_create_manager' (4dde78ce-c8cf-4d9d-912f-1356fc4064f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db13071c-6d85-4bd8-9bb9-53d2ca4455f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db13071c-6d85-4bd8-9bb9-53d2ca4455f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4209318-cdde-4832-b6c1-3415dfcf14b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd47bc220874ba6955b9f94292bb9b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:50Z,use_quota=True,user_id='51d33240106c4e429926e07ee9c40745',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17a1366-62d0-4f97-a9f8-00c18070146b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17a1366-62d0-4f97-a9f8-00c18070146b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa3dc536-f262-44f6-b450-569210f589bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG cinder.image.glance [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Creating Keystone auth plugin from conf {{(pid=87054) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 07 02:43:50 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b3732d6-4f33-40a6-8a27-8de5e57b728c_52juuvktdevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0e6337d-4476-4455-baae-2e91276589af" returned: 0 in 2.381s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4b3732d6-4f33-40a6-8a27-8de5e57b728c_52juuvktdevstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0e6337d-4476-4455-baae-2e91276589af {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:43:50 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Converted 112.00 MB image at 47.01 MB/s
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0e6337d-4476-4455-baae-2e91276589af 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:50 devstack sudo[102107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0e6337d-4476-4455-baae-2e91276589af 1G
Nov 07 02:43:50 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa3dc536-f262-44f6-b450-569210f589bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c4209318-cdde-4832-b6c1-3415dfcf14b1', 'volume_name': 'volume-c4209318-cdde-4832-b6c1-3415dfcf14b1', 'volume_size': 1, 'image_id': '593a3297-52cb-4aaf-9da7-8bbd5e4950b8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/593a3297-52cb-4aaf-9da7-8bbd5e4950b8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '898033622af7a6d32d040a0c1c282ad9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7fd47bc220874ba6955b9f94292bb9b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f8656cb962acd9f78269cd84173bd5b063594ce6f76b01c68dba1207e1459150a75b0227fd81eb7fe4ec64c17cc3c22db688e9e43613ef53eb7bed798132dc15', 'id': '593a3297-52cb-4aaf-9da7-8bbd5e4950b8', 'created_at': datetime.datetime(2026, 11, 7, 1, 43, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 43, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/593a3297-52cb-4aaf-9da7-8bbd5e4950b8/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x721709f1b470>}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc5e932-a64b-46df-af01-197466ee29b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc5e932-a64b-46df-af01-197466ee29b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f924ab-cd79-41de-a5bb-f6a251b762ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:50 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Volume c4209318-cdde-4832-b6c1-3415dfcf14b1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c4209318-cdde-4832-b6c1-3415dfcf14b1', 'volume_size': 1, 'image_id': '593a3297-52cb-4aaf-9da7-8bbd5e4950b8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/593a3297-52cb-4aaf-9da7-8bbd5e4950b8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '898033622af7a6d32d040a0c1c282ad9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7fd47bc220874ba6955b9f94292bb9b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f8656cb962acd9f78269cd84173bd5b063594ce6f76b01c68dba1207e1459150a75b0227fd81eb7fe4ec64c17cc3c22db688e9e43613ef53eb7bed798132dc15', 'id': '593a3297-52cb-4aaf-9da7-8bbd5e4950b8', 'created_at': datetime.datetime(2026, 11, 7, 1, 43, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 43, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/593a3297-52cb-4aaf-9da7-8bbd5e4950b8/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x721709f1b470>}
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Trying to clone c4209318-cdde-4832-b6c1-3415dfcf14b1 from image 593a3297-52cb-4aaf-9da7-8bbd5e4950b8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/593a3297-52cb-4aaf-9da7-8bbd5e4950b8', 'metadata': {}}]). {{(pid=87054) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 07 02:43:50 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Image download 0.00 MB at 0.00 MB/s
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d085cf-5599-48c9-b0a6-edd9e1cd276d]: (4, 'raw') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:50 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0e6337d-4476-4455-baae-2e91276589af 1G" returned: 0 in 0.376s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Downloaded image 4b3732d6-4f33-40a6-8a27-8de5e57b728c ((None, [{'url': 'file:///opt/stack/data/glance/images/4b3732d6-4f33-40a6-8a27-8de5e57b728c', 'metadata': {}}])) to volume d0e6337d-4476-4455-baae-2e91276589af successfully. {{(pid=87054) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Temporary image 4b3732d6-4f33-40a6-8a27-8de5e57b728c for user 33f012e1f4c94364b2ab543205feae8f is deleted. {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Marking volume d0e6337d-4476-4455-baae-2e91276589af as bootable. {{(pid=87054) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Copying metadata from image 4b3732d6-4f33-40a6-8a27-8de5e57b728c to d0e6337d-4476-4455-baae-2e91276589af. {{(pid=87054) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Creating volume glance metadata for volume d0e6337d-4476-4455-baae-2e91276589af backed by image 4b3732d6-4f33-40a6-8a27-8de5e57b728c with: {'image_id': '4b3732d6-4f33-40a6-8a27-8de5e57b728c', 'image_name': 'tempest-scenario-img--899446521', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87054) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 07 02:43:50 devstack sudo[102112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD
Nov 07 02:43:50 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5708a204-eb9d-4cb5-9f5c-069d6e469155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0e6337d-4476-4455-baae-2e91276589af', 'volume_size': 1, 'image_id': '4b3732d6-4f33-40a6-8a27-8de5e57b728c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b3732d6-4f33-40a6-8a27-8de5e57b728c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--899446521', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f6618eafeb041ce9cd2c43aa57f5072', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b3732d6-4f33-40a6-8a27-8de5e57b728c', 'created_at': datetime.datetime(2026, 11, 7, 1, 43, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 43, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b3732d6-4f33-40a6-8a27-8de5e57b728c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x721709ef7b90>}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764f2441-dbb1-447c-b62d-4a17073c9287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:50 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Volume volume-d0e6337d-4476-4455-baae-2e91276589af (d0e6337d-4476-4455-baae-2e91276589af): created successfully
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764f2441-dbb1-447c-b62d-4a17073c9287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Flow 'volume_create_manager' (77d837a8-3bcd-4df8-a571-43cddf65ee21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:50 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-e57f3ad9-6554-4b45-881a-90cbcdcc8176 tempest-TestInstancesWithCinderVolumes-710842639 None] Created volume successfully.
Nov 07 02:43:50 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:50 devstack sudo[102117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD
Nov 07 02:43:50 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:51 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD" returned: 1 in 0.311s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:43:51 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Temporary image 593a3297-52cb-4aaf-9da7-8bbd5e4950b8 is fetched for user 51d33240106c4e429926e07ee9c40745. {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 07 02:43:51 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[964aca66-b679-41ac-9e2e-dd536a27863b]: (4, 'raw') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:51 devstack sudo[102122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD
Nov 07 02:43:51 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:51 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:51 devstack sudo[102126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD
Nov 07 02:43:51 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:51 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD" returned: 1 in 0.343s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:43:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:51 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4209318-cdde-4832-b6c1-3415dfcf14b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd47bc220874ba6955b9f94292bb9b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:43:50Z,use_quota=True,user_id='51d33240106c4e429926e07ee9c40745',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:43:51 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Creating volume c4209318-cdde-4832-b6c1-3415dfcf14b1 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:43:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:51 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:51 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:51 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:43:51 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:43:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c4209318-cdde-4832-b6c1-3415dfcf14b1 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:52 devstack sudo[102131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c4209318-cdde-4832-b6c1-3415dfcf14b1 1073741824
Nov 07 02:43:52 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:52 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c4209318-cdde-4832-b6c1-3415dfcf14b1 1073741824" returned: 0 in 0.549s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c4209318-cdde-4832-b6c1-3415dfcf14b1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:52 devstack sudo[102137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c4209318-cdde-4832-b6c1-3415dfcf14b1
Nov 07 02:43:52 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:52 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c4209318-cdde-4832-b6c1-3415dfcf14b1" returned: 0 in 0.267s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:43:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:52 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Attempting download of 593a3297-52cb-4aaf-9da7-8bbd5e4950b8 ((None, [{'url': 'file:///opt/stack/data/glance/images/593a3297-52cb-4aaf-9da7-8bbd5e4950b8', 'metadata': {}}])) to volume c4209318-cdde-4832-b6c1-3415dfcf14b1. {{(pid=87054) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 07 02:43:52 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d13d444-ee26-4cbc-ac40-7d1dad3fcb09]: (4, 'raw') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_tmm89zki {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:53 devstack sudo[102140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_tmm89zki
Nov 07 02:43:53 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:53 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_tmm89zki" returned: 0 in 0.416s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_tmm89zki {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:53 devstack sudo[102147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_tmm89zki
Nov 07 02:43:53 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:53 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_tmm89zki" returned: 1 in 0.542s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_tmm89zki' failed. Not Retrying. {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:43:53 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe125b3d-432f-4439-806f-b7523553f47f]: (4, 'raw') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:54 devstack sudo[102151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD
Nov 07 02:43:54 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:54 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:54 devstack sudo[102155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD
Nov 07 02:43:54 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:54 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD" returned: 1 in 0.465s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:43:54 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] 593a3297-52cb-4aaf-9da7-8bbd5e4950b8 was raw, converting to qcow2 {{(pid=87054) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 07 02:43:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c4209318-cdde-4832-b6c1-3415dfcf14b1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:54 devstack sudo[102164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c4209318-cdde-4832-b6c1-3415dfcf14b1
Nov 07 02:43:54 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-ff29b9d3-ce7c-40bc-b5c6-373780c09490 req-ea36b2a4-12b4-48b3-b177-923a29112246 tempest-TestInstancesWithCinderVolumes-710842639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-ff29b9d3-ce7c-40bc-b5c6-373780c09490 req-ea36b2a4-12b4-48b3-b177-923a29112246 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-ff29b9d3-ce7c-40bc-b5c6-373780c09490 req-ea36b2a4-12b4-48b3-b177-923a29112246 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-ff29b9d3-ce7c-40bc-b5c6-373780c09490 req-ea36b2a4-12b4-48b3-b177-923a29112246 tempest-TestInstancesWithCinderVolumes-710842639 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c', 'name': 'volume-d0e6337d-4476-4455-baae-2e91276589af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01db7c44-5d96-4ab6-8647-4d44ddf43632', 'enforce_multipath': True} {{(pid=87054) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:43:55 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-ff29b9d3-ce7c-40bc-b5c6-373780c09490 req-ea36b2a4-12b4-48b3-b177-923a29112246 tempest-TestInstancesWithCinderVolumes-710842639 None] attachment_update completed successfully.
Nov 07 02:43:55 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c4209318-cdde-4832-b6c1-3415dfcf14b1" returned: 0 in 0.647s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:55 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_593a3297-52cb-4aaf-9da7-8bbd5e4950b8_73pxz2jedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c4209318-cdde-4832-b6c1-3415dfcf14b1 {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:43:55 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Converted 0.00 MB image at 0.00 MB/s
Nov 07 02:43:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c4209318-cdde-4832-b6c1-3415dfcf14b1 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:55 devstack sudo[102174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c4209318-cdde-4832-b6c1-3415dfcf14b1 1G
Nov 07 02:43:55 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:55 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c4209318-cdde-4832-b6c1-3415dfcf14b1 1G" returned: 0 in 0.451s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:55 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Downloaded image 593a3297-52cb-4aaf-9da7-8bbd5e4950b8 ((None, [{'url': 'file:///opt/stack/data/glance/images/593a3297-52cb-4aaf-9da7-8bbd5e4950b8', 'metadata': {}}])) to volume c4209318-cdde-4832-b6c1-3415dfcf14b1 successfully. {{(pid=87054) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 07 02:43:55 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Temporary image 593a3297-52cb-4aaf-9da7-8bbd5e4950b8 for user 51d33240106c4e429926e07ee9c40745 is deleted. {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 07 02:43:55 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Marking volume c4209318-cdde-4832-b6c1-3415dfcf14b1 as bootable. {{(pid=87054) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 07 02:43:55 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Copying metadata from image 593a3297-52cb-4aaf-9da7-8bbd5e4950b8 to c4209318-cdde-4832-b6c1-3415dfcf14b1. {{(pid=87054) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 07 02:43:55 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Creating volume glance metadata for volume c4209318-cdde-4832-b6c1-3415dfcf14b1 backed by image 593a3297-52cb-4aaf-9da7-8bbd5e4950b8 with: {'image_id': '593a3297-52cb-4aaf-9da7-8bbd5e4950b8', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '898033622af7a6d32d040a0c1c282ad9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87054) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 07 02:43:56 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f924ab-cd79-41de-a5bb-f6a251b762ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4209318-cdde-4832-b6c1-3415dfcf14b1', 'volume_size': 1, 'image_id': '593a3297-52cb-4aaf-9da7-8bbd5e4950b8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/593a3297-52cb-4aaf-9da7-8bbd5e4950b8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '898033622af7a6d32d040a0c1c282ad9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7fd47bc220874ba6955b9f94292bb9b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f8656cb962acd9f78269cd84173bd5b063594ce6f76b01c68dba1207e1459150a75b0227fd81eb7fe4ec64c17cc3c22db688e9e43613ef53eb7bed798132dc15', 'id': '593a3297-52cb-4aaf-9da7-8bbd5e4950b8', 'created_at': datetime.datetime(2026, 11, 7, 1, 43, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 43, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/593a3297-52cb-4aaf-9da7-8bbd5e4950b8/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x721709f1b470>}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:56 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c016ff-1324-4f13-9b03-50b881775af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:43:56 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Volume volume-c4209318-cdde-4832-b6c1-3415dfcf14b1 (c4209318-cdde-4832-b6c1-3415dfcf14b1): created successfully
Nov 07 02:43:56 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c016ff-1324-4f13-9b03-50b881775af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:43:56 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Flow 'volume_create_manager' (4dde78ce-c8cf-4d9d-912f-1356fc4064f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:43:56 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-39ea41ef-1768-4b36-bd10-e83fab99e903 tempest-VolumeImageDependencyTests-652579180 None] Created volume successfully.
Nov 07 02:43:56 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a203135f-a6d9-4490-b354-47c18b8839a1 tempest-VolumeImageDependencyTests-652579180 None] Acquiring lock "cinder-c4209318-cdde-4832-b6c1-3415dfcf14b1-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:56 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a203135f-a6d9-4490-b354-47c18b8839a1 tempest-VolumeImageDependencyTests-652579180 None] Lock "cinder-c4209318-cdde-4832-b6c1-3415dfcf14b1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:56 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a203135f-a6d9-4490-b354-47c18b8839a1 tempest-VolumeImageDependencyTests-652579180 None] Acquiring lock "cinder-quobyte-c4209318-cdde-4832-b6c1-3415dfcf14b1" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:43:56 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a203135f-a6d9-4490-b354-47c18b8839a1 tempest-VolumeImageDependencyTests-652579180 None] Lock "cinder-quobyte-c4209318-cdde-4832-b6c1-3415dfcf14b1" acquired by "delete_volume" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:43:56 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[deed8dce-8177-4562-8bd4-9741bae28182]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:43:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a203135f-a6d9-4490-b354-47c18b8839a1 tempest-VolumeImageDependencyTests-652579180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c4209318-cdde-4832-b6c1-3415dfcf14b1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:56 devstack sudo[102180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c4209318-cdde-4832-b6c1-3415dfcf14b1
Nov 07 02:43:56 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:57 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a203135f-a6d9-4490-b354-47c18b8839a1 tempest-VolumeImageDependencyTests-652579180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c4209318-cdde-4832-b6c1-3415dfcf14b1" returned: 0 in 0.444s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a203135f-a6d9-4490-b354-47c18b8839a1 tempest-VolumeImageDependencyTests-652579180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c4209318-cdde-4832-b6c1-3415dfcf14b1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:57 devstack sudo[102185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c4209318-cdde-4832-b6c1-3415dfcf14b1
Nov 07 02:43:57 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:57 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a203135f-a6d9-4490-b354-47c18b8839a1 tempest-VolumeImageDependencyTests-652579180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c4209318-cdde-4832-b6c1-3415dfcf14b1" returned: 0 in 0.271s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:57 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a203135f-a6d9-4490-b354-47c18b8839a1 tempest-VolumeImageDependencyTests-652579180 None] Lock "cinder-quobyte-c4209318-cdde-4832-b6c1-3415dfcf14b1" released by "delete_volume" :: held 0.767s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:57 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-a203135f-a6d9-4490-b354-47c18b8839a1 tempest-VolumeImageDependencyTests-652579180 None] Created reservations ['2b97e9db-289f-4d08-8928-4d99298c7ce2', '57dd4735-2240-490e-8ba5-608e31a77ebc', '81d58f08-5a63-46c5-9295-7fee15899ca1', '42aae34d-ff58-4b67-ba64-12e8496ab3cd'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:43:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a203135f-a6d9-4490-b354-47c18b8839a1 tempest-VolumeImageDependencyTests-652579180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a203135f-a6d9-4490-b354-47c18b8839a1 tempest-VolumeImageDependencyTests-652579180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:57 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a203135f-a6d9-4490-b354-47c18b8839a1 tempest-VolumeImageDependencyTests-652579180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:57 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a203135f-a6d9-4490-b354-47c18b8839a1 tempest-VolumeImageDependencyTests-652579180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a203135f-a6d9-4490-b354-47c18b8839a1 tempest-VolumeImageDependencyTests-652579180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a203135f-a6d9-4490-b354-47c18b8839a1 tempest-VolumeImageDependencyTests-652579180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:57 devstack sudo[102188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:43:57 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:57 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a203135f-a6d9-4490-b354-47c18b8839a1 tempest-VolumeImageDependencyTests-652579180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.322s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:57 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-a203135f-a6d9-4490-b354-47c18b8839a1 tempest-VolumeImageDependencyTests-652579180 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:57 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-a203135f-a6d9-4490-b354-47c18b8839a1 tempest-VolumeImageDependencyTests-652579180 None] Deleted volume successfully.
Nov 07 02:43:57 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a203135f-a6d9-4490-b354-47c18b8839a1 tempest-VolumeImageDependencyTests-652579180 None] Lock "cinder-c4209318-cdde-4832-b6c1-3415dfcf14b1-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:43:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:43:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:43:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:43:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:43:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:43:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:43:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:43:59 devstack sudo[102193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:43:59 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:43:59 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root
Nov 07 02:43:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.352s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:43:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:43:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:43:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 28 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:43:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>, <Thread(fd_logger, started daemon 125443282798592)>, <Thread(privsep_reader, started daemon 125443284556288)>, <Thread(tpool_thread_0, started daemon 125443276445376)>, <Thread(tpool_thread_1, started daemon 125443268036288)>, <Thread(tpool_thread_2, started daemon 125443259627200)>, <Thread(tpool_thread_3, started daemon 125443251218112)>, <Thread(tpool_thread_4, started daemon 125443242809024)>, <Thread(tpool_thread_5, started daemon 125443234399936)>, <Thread(tpool_thread_6, started daemon 125443225990848)>, <Thread(tpool_thread_7, started daemon 125443217581760)>, <Thread(tpool_thread_8, started daemon 125443209172672)>, <Thread(tpool_thread_9, started daemon 125443200763584)>, <Thread(tpool_thread_10, started daemon 125443192354496)>, <Thread(tpool_thread_11, started daemon 125443183945408)>, <Thread(tpool_thread_12, started daemon 125443175536320)>, <Thread(tpool_thread_13, started daemon 125443167127232)>, <Thread(tpool_thread_14, started daemon 125443158718144)>, <Thread(tpool_thread_15, started daemon 125443150309056)>, <Thread(tpool_thread_16, started daemon 125443141899968)>, <Thread(tpool_thread_17, started daemon 125443133490880)>, <Thread(tpool_thread_18, started daemon 125443125081792)>, <Thread(tpool_thread_19, started daemon 125443116672704)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:44:03 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:44:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Flow 'volume_create_manager' (9e50959f-e51f-458b-8ae3-9540a0428c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:44:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2185745d-0ffb-475b-a373-919a73abb6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2185745d-0ffb-475b-a373-919a73abb6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=593c5376-54af-4f5e-ac68-2e992a0bf7d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdde4c8f605348e29026f722c064764a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:44:03Z,use_quota=True,user_id='ab6e5603f96a480488cc909bb4d3e73a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c72bae-f87f-4365-b003-706b96fd675b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c72bae-f87f-4365-b003-706b96fd675b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5211f5ee-37f1-4e9c-8825-d8e830f0f3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5211f5ee-37f1-4e9c-8825-d8e830f0f3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '593c5376-54af-4f5e-ac68-2e992a0bf7d5', 'volume_name': 'volume-593c5376-54af-4f5e-ac68-2e992a0bf7d5', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f87dfa-9e36-48d4-bc76-6867b04530fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f87dfa-9e36-48d4-bc76-6867b04530fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6ee2a7-0612-4bb1-a08e-b80282f6869f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:03 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Volume 593c5376-54af-4f5e-ac68-2e992a0bf7d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-593c5376-54af-4f5e-ac68-2e992a0bf7d5', 'volume_size': 1}
Nov 07 02:44:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=593c5376-54af-4f5e-ac68-2e992a0bf7d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdde4c8f605348e29026f722c064764a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:44:03Z,use_quota=True,user_id='ab6e5603f96a480488cc909bb4d3e73a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:44:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Creating volume 593c5376-54af-4f5e-ac68-2e992a0bf7d5 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:44:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:44:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:44:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:44:03 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:44:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-593c5376-54af-4f5e-ac68-2e992a0bf7d5 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:03 devstack sudo[102713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-593c5376-54af-4f5e-ac68-2e992a0bf7d5 1073741824
Nov 07 02:44:03 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:04 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-593c5376-54af-4f5e-ac68-2e992a0bf7d5 1073741824" returned: 0 in 0.575s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-593c5376-54af-4f5e-ac68-2e992a0bf7d5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:04 devstack sudo[102719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-593c5376-54af-4f5e-ac68-2e992a0bf7d5
Nov 07 02:44:04 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:04 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-593c5376-54af-4f5e-ac68-2e992a0bf7d5" returned: 0 in 0.381s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:44:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6ee2a7-0612-4bb1-a08e-b80282f6869f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-593c5376-54af-4f5e-ac68-2e992a0bf7d5', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65bc9fd-f773-4e39-bbef-f0a7e7cfe184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:04 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Volume volume-593c5376-54af-4f5e-ac68-2e992a0bf7d5 (593c5376-54af-4f5e-ac68-2e992a0bf7d5): created successfully
Nov 07 02:44:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65bc9fd-f773-4e39-bbef-f0a7e7cfe184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Flow 'volume_create_manager' (9e50959f-e51f-458b-8ae3-9540a0428c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:44:04 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-cc0aad7d-39ca-42e5-83c9-ac8b5b77fc57 tempest-CinderUnicodeTest-1933199946 None] Created volume successfully.
Nov 07 02:44:06 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:44:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Flow 'volume_create_manager' (b87a2fe5-c7ef-4945-971f-0c9911309573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:44:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a26a3ad-8664-4af6-9cd6-145a9ba5bd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a26a3ad-8664-4af6-9cd6-145a9ba5bd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:44:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-353796421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ba8ccd-a57d-41cc-ab94-e081232ed0bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdde4c8f605348e29026f722c064764a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:44:06Z,use_quota=True,user_id='ab6e5603f96a480488cc909bb4d3e73a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972bddbb-7e5d-4ac5-8b60-cdf696f12e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972bddbb-7e5d-4ac5-8b60-cdf696f12e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2081e0e-46ad-4f8f-9a8e-b76bbdec4afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2081e0e-46ad-4f8f-9a8e-b76bbdec4afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22ba8ccd-a57d-41cc-ab94-e081232ed0bc', 'volume_name': 'volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d25037-4f6d-489b-911a-572e70ce17ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d25037-4f6d-489b-911a-572e70ce17ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:06 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47cbd67-8006-4e2b-bc88-45e352f3886d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:06 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Volume 22ba8ccd-a57d-41cc-ab94-e081232ed0bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc', 'volume_size': 1}
Nov 07 02:44:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:44:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-353796421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ba8ccd-a57d-41cc-ab94-e081232ed0bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdde4c8f605348e29026f722c064764a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:44:06Z,use_quota=True,user_id='ab6e5603f96a480488cc909bb4d3e73a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:44:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Creating volume 22ba8ccd-a57d-41cc-ab94-e081232ed0bc {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:44:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:44:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:44:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:06 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:44:06 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:44:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:06 devstack sudo[102724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc 1073741824
Nov 07 02:44:06 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:07 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc 1073741824" returned: 0 in 0.825s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:07 devstack sudo[102730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc
Nov 07 02:44:07 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:07 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc" returned: 0 in 0.508s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:07 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:44:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47cbd67-8006-4e2b-bc88-45e352f3886d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:07 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fb38ef-1dbe-4ef3-84b0-4a1d5eac7046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:07 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Volume volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc (22ba8ccd-a57d-41cc-ab94-e081232ed0bc): created successfully
Nov 07 02:44:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fb38ef-1dbe-4ef3-84b0-4a1d5eac7046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Flow 'volume_create_manager' (b87a2fe5-c7ef-4945-971f-0c9911309573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:44:08 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-aeac2ae2-f9d4-40e2-9385-5410c7add092 tempest-CinderUnicodeTest-1933199946 None] Created volume successfully.
Nov 07 02:44:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-38f6dba8-d556-4af4-b5c5-86162e0ea8c1 tempest-CinderUnicodeTest-1933199946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-38f6dba8-d556-4af4-b5c5-86162e0ea8c1 tempest-CinderUnicodeTest-1933199946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-38f6dba8-d556-4af4-b5c5-86162e0ea8c1 tempest-CinderUnicodeTest-1933199946 None] Creating offline snapshot 6e2e8b28-3f51-4554-8daa-f856724cb6d6 of volume 22ba8ccd-a57d-41cc-ab94-e081232ed0bc {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:44:08 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[481624bf-fe67-4b1c-824f-e7a8e5d3e9e4]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:44:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38f6dba8-d556-4af4-b5c5-86162e0ea8c1 tempest-CinderUnicodeTest-1933199946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:09 devstack sudo[102735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc
Nov 07 02:44:09 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:09 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38f6dba8-d556-4af4-b5c5-86162e0ea8c1 tempest-CinderUnicodeTest-1933199946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc" returned: 0 in 0.549s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38f6dba8-d556-4af4-b5c5-86162e0ea8c1 tempest-CinderUnicodeTest-1933199946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.6e2e8b28-3f51-4554-8daa-f856724cb6d6 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:09 devstack sudo[102740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.6e2e8b28-3f51-4554-8daa-f856724cb6d6 1G
Nov 07 02:44:09 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:10 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38f6dba8-d556-4af4-b5c5-86162e0ea8c1 tempest-CinderUnicodeTest-1933199946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.6e2e8b28-3f51-4554-8daa-f856724cb6d6 1G" returned: 0 in 0.704s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38f6dba8-d556-4af4-b5c5-86162e0ea8c1 tempest-CinderUnicodeTest-1933199946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.6e2e8b28-3f51-4554-8daa-f856724cb6d6 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:10 devstack sudo[102745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.6e2e8b28-3f51-4554-8daa-f856724cb6d6
Nov 07 02:44:10 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:10 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38f6dba8-d556-4af4-b5c5-86162e0ea8c1 tempest-CinderUnicodeTest-1933199946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.6e2e8b28-3f51-4554-8daa-f856724cb6d6" returned: 0 in 0.397s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:10 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-38f6dba8-d556-4af4-b5c5-86162e0ea8c1 tempest-CinderUnicodeTest-1933199946 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.6e2e8b28-3f51-4554-8daa-f856724cb6d6 is being set with open permissions: ugo+rw
Nov 07 02:44:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38f6dba8-d556-4af4-b5c5-86162e0ea8c1 tempest-CinderUnicodeTest-1933199946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.6e2e8b28-3f51-4554-8daa-f856724cb6d6 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:10 devstack sudo[102751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.6e2e8b28-3f51-4554-8daa-f856724cb6d6
Nov 07 02:44:10 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:10 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38f6dba8-d556-4af4-b5c5-86162e0ea8c1 tempest-CinderUnicodeTest-1933199946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.6e2e8b28-3f51-4554-8daa-f856724cb6d6" returned: 0 in 0.348s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38f6dba8-d556-4af4-b5c5-86162e0ea8c1 tempest-CinderUnicodeTest-1933199946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:11 devstack sudo[102754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.info
Nov 07 02:44:11 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:11 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38f6dba8-d556-4af4-b5c5-86162e0ea8c1 tempest-CinderUnicodeTest-1933199946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.info" returned: 0 in 0.383s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:11 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-38f6dba8-d556-4af4-b5c5-86162e0ea8c1 tempest-CinderUnicodeTest-1933199946 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.info is being set with open permissions: ugo+rw
Nov 07 02:44:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38f6dba8-d556-4af4-b5c5-86162e0ea8c1 tempest-CinderUnicodeTest-1933199946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:11 devstack sudo[102757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.info
Nov 07 02:44:11 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:11 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38f6dba8-d556-4af4-b5c5-86162e0ea8c1 tempest-CinderUnicodeTest-1933199946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.info" returned: 0 in 0.315s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-38f6dba8-d556-4af4-b5c5-86162e0ea8c1 tempest-CinderUnicodeTest-1933199946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.861s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:11 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-38f6dba8-d556-4af4-b5c5-86162e0ea8c1 tempest-CinderUnicodeTest-1933199946 None] Create snapshot completed successfully
Nov 07 02:44:12 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-64c4f3aa-8b2e-41b8-b8db-e204539c334d tempest-CinderUnicodeTest-1933199946 None] Acquiring lock "cinder-6e2e8b28-3f51-4554-8daa-f856724cb6d6-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:12 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-64c4f3aa-8b2e-41b8-b8db-e204539c334d tempest-CinderUnicodeTest-1933199946 None] Lock "cinder-6e2e8b28-3f51-4554-8daa-f856724cb6d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:12 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-64c4f3aa-8b2e-41b8-b8db-e204539c334d tempest-CinderUnicodeTest-1933199946 None] Acquiring lock "cinder-quobyte-22ba8ccd-a57d-41cc-ab94-e081232ed0bc" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:12 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-64c4f3aa-8b2e-41b8-b8db-e204539c334d tempest-CinderUnicodeTest-1933199946 None] Lock "cinder-quobyte-22ba8ccd-a57d-41cc-ab94-e081232ed0bc" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:12 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-64c4f3aa-8b2e-41b8-b8db-e204539c334d tempest-CinderUnicodeTest-1933199946 None] Acquiring lock "cinder-quobyte-6e2e8b28-3f51-4554-8daa-f856724cb6d6" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:12 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-64c4f3aa-8b2e-41b8-b8db-e204539c334d tempest-CinderUnicodeTest-1933199946 None] Lock "cinder-quobyte-6e2e8b28-3f51-4554-8daa-f856724cb6d6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-64c4f3aa-8b2e-41b8-b8db-e204539c334d tempest-CinderUnicodeTest-1933199946 None] Deleting offline snapshot 6e2e8b28-3f51-4554-8daa-f856724cb6d6 of volume 22ba8ccd-a57d-41cc-ab94-e081232ed0bc {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:44:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-64c4f3aa-8b2e-41b8-b8db-e204539c334d tempest-CinderUnicodeTest-1933199946 None] snapshot_file for this snap is: volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.6e2e8b28-3f51-4554-8daa-f856724cb6d6 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:44:12 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[920a7e37-3700-429f-a096-51fcfdb5d3ff]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:44:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-64c4f3aa-8b2e-41b8-b8db-e204539c334d tempest-CinderUnicodeTest-1933199946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.6e2e8b28-3f51-4554-8daa-f856724cb6d6 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:12 devstack sudo[102761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.6e2e8b28-3f51-4554-8daa-f856724cb6d6
Nov 07 02:44:12 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:13 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-64c4f3aa-8b2e-41b8-b8db-e204539c334d tempest-CinderUnicodeTest-1933199946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.6e2e8b28-3f51-4554-8daa-f856724cb6d6" returned: 0 in 0.645s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-64c4f3aa-8b2e-41b8-b8db-e204539c334d tempest-CinderUnicodeTest-1933199946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:44:13 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa48133-8a33-4e2d-8f74-f271d55a0c1b]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:44:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-64c4f3aa-8b2e-41b8-b8db-e204539c334d tempest-CinderUnicodeTest-1933199946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:13 devstack sudo[102766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc
Nov 07 02:44:13 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:13 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-64c4f3aa-8b2e-41b8-b8db-e204539c334d tempest-CinderUnicodeTest-1933199946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc" returned: 0 in 0.669s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-64c4f3aa-8b2e-41b8-b8db-e204539c334d tempest-CinderUnicodeTest-1933199946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.6e2e8b28-3f51-4554-8daa-f856724cb6d6 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:13 devstack sudo[102771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.6e2e8b28-3f51-4554-8daa-f856724cb6d6
Nov 07 02:44:13 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:14 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-64c4f3aa-8b2e-41b8-b8db-e204539c334d tempest-CinderUnicodeTest-1933199946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.6e2e8b28-3f51-4554-8daa-f856724cb6d6" returned: 0 in 0.480s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-64c4f3aa-8b2e-41b8-b8db-e204539c334d tempest-CinderUnicodeTest-1933199946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.6e2e8b28-3f51-4554-8daa-f856724cb6d6 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:14 devstack sudo[102777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.6e2e8b28-3f51-4554-8daa-f856724cb6d6
Nov 07 02:44:14 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:14 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-64c4f3aa-8b2e-41b8-b8db-e204539c334d tempest-CinderUnicodeTest-1933199946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc.6e2e8b28-3f51-4554-8daa-f856724cb6d6" returned: 0 in 0.570s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:14 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-64c4f3aa-8b2e-41b8-b8db-e204539c334d tempest-CinderUnicodeTest-1933199946 None] Lock "cinder-quobyte-6e2e8b28-3f51-4554-8daa-f856724cb6d6" released by "_delete_snapshot" :: held 2.543s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:14 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-64c4f3aa-8b2e-41b8-b8db-e204539c334d tempest-CinderUnicodeTest-1933199946 None] Lock "cinder-quobyte-22ba8ccd-a57d-41cc-ab94-e081232ed0bc" released by "delete_snapshot" :: held 2.589s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:15 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-64c4f3aa-8b2e-41b8-b8db-e204539c334d tempest-CinderUnicodeTest-1933199946 None] Created reservations ['3d809377-16f0-4089-8765-60166e94d1eb', '136c4377-5b60-4a09-9fc6-2e5a8a1f90a3', 'a351de53-d4d3-432f-b893-a99551939bd0', '32efba3a-24d8-483e-91b1-a4d05998efc0'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:44:15 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-64c4f3aa-8b2e-41b8-b8db-e204539c334d tempest-CinderUnicodeTest-1933199946 None] Delete snapshot completed successfully.
Nov 07 02:44:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-64c4f3aa-8b2e-41b8-b8db-e204539c334d tempest-CinderUnicodeTest-1933199946 None] Lock "cinder-6e2e8b28-3f51-4554-8daa-f856724cb6d6-delete_snapshot" released by "delete_snapshot" :: held 2.879s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-553514af-a85f-4478-8f30-d621f5831a21 tempest-CinderUnicodeTest-1933199946 None] Acquiring lock "cinder-22ba8ccd-a57d-41cc-ab94-e081232ed0bc-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-553514af-a85f-4478-8f30-d621f5831a21 tempest-CinderUnicodeTest-1933199946 None] Lock "cinder-22ba8ccd-a57d-41cc-ab94-e081232ed0bc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:15 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=136,cinder:INSERT=32,cinder:UPDATE=160,cinder:DELETE=10 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:44:15 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:DELETE=18,cinder:SELECT=119,cinder:INSERT=57,cinder:UPDATE=160 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:44:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-553514af-a85f-4478-8f30-d621f5831a21 tempest-CinderUnicodeTest-1933199946 None] Acquiring lock "cinder-quobyte-22ba8ccd-a57d-41cc-ab94-e081232ed0bc" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-553514af-a85f-4478-8f30-d621f5831a21 tempest-CinderUnicodeTest-1933199946 None] Lock "cinder-quobyte-22ba8ccd-a57d-41cc-ab94-e081232ed0bc" acquired by "delete_volume" :: waited 0.037s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:15 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3f1790-f46b-499c-9649-70d7defe74ea]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:44:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-553514af-a85f-4478-8f30-d621f5831a21 tempest-CinderUnicodeTest-1933199946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:15 devstack sudo[102787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc
Nov 07 02:44:15 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:16 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-553514af-a85f-4478-8f30-d621f5831a21 tempest-CinderUnicodeTest-1933199946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc" returned: 0 in 0.390s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-553514af-a85f-4478-8f30-d621f5831a21 tempest-CinderUnicodeTest-1933199946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:16 devstack sudo[102792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc
Nov 07 02:44:16 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:16 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-553514af-a85f-4478-8f30-d621f5831a21 tempest-CinderUnicodeTest-1933199946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-22ba8ccd-a57d-41cc-ab94-e081232ed0bc" returned: 0 in 0.328s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-553514af-a85f-4478-8f30-d621f5831a21 tempest-CinderUnicodeTest-1933199946 None] Lock "cinder-quobyte-22ba8ccd-a57d-41cc-ab94-e081232ed0bc" released by "delete_volume" :: held 0.790s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:16 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-553514af-a85f-4478-8f30-d621f5831a21 tempest-CinderUnicodeTest-1933199946 None] Created reservations ['a99dddc9-65df-41b7-9429-0ca667ceefd6', '47fcf8e4-77f2-4874-ac58-f808cc8283b9', 'e7fe4641-61a6-42da-aa6b-5dd1764140b1', 'a2a1cf39-9d61-421a-a0fc-e00fe0d11f87'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:44:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-553514af-a85f-4478-8f30-d621f5831a21 tempest-CinderUnicodeTest-1933199946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-553514af-a85f-4478-8f30-d621f5831a21 tempest-CinderUnicodeTest-1933199946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-553514af-a85f-4478-8f30-d621f5831a21 tempest-CinderUnicodeTest-1933199946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:44:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-553514af-a85f-4478-8f30-d621f5831a21 tempest-CinderUnicodeTest-1933199946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:44:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-553514af-a85f-4478-8f30-d621f5831a21 tempest-CinderUnicodeTest-1933199946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-553514af-a85f-4478-8f30-d621f5831a21 tempest-CinderUnicodeTest-1933199946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:16 devstack sudo[102798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:44:16 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-bf5a9215-4690-41a3-96bd-0cd0fe1fd0d5 tempest-CinderUnicodeTest-1933199946 None] Acquiring lock "cinder-593c5376-54af-4f5e-ac68-2e992a0bf7d5-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-bf5a9215-4690-41a3-96bd-0cd0fe1fd0d5 tempest-CinderUnicodeTest-1933199946 None] Lock "cinder-593c5376-54af-4f5e-ac68-2e992a0bf7d5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:16 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-553514af-a85f-4478-8f30-d621f5831a21 tempest-CinderUnicodeTest-1933199946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.320s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:16 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-553514af-a85f-4478-8f30-d621f5831a21 tempest-CinderUnicodeTest-1933199946 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:44:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-bf5a9215-4690-41a3-96bd-0cd0fe1fd0d5 tempest-CinderUnicodeTest-1933199946 None] Acquiring lock "cinder-quobyte-593c5376-54af-4f5e-ac68-2e992a0bf7d5" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:16 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-553514af-a85f-4478-8f30-d621f5831a21 tempest-CinderUnicodeTest-1933199946 None] Deleted volume successfully.
Nov 07 02:44:17 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-bf5a9215-4690-41a3-96bd-0cd0fe1fd0d5 tempest-CinderUnicodeTest-1933199946 None] Lock "cinder-quobyte-593c5376-54af-4f5e-ac68-2e992a0bf7d5" acquired by "delete_volume" :: waited 0.034s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:17 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-553514af-a85f-4478-8f30-d621f5831a21 tempest-CinderUnicodeTest-1933199946 None] Lock "cinder-22ba8ccd-a57d-41cc-ab94-e081232ed0bc-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:17 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e19409-8b30-4e14-b52b-8283c66a8a2b]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:44:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bf5a9215-4690-41a3-96bd-0cd0fe1fd0d5 tempest-CinderUnicodeTest-1933199946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-593c5376-54af-4f5e-ac68-2e992a0bf7d5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:17 devstack sudo[102801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-593c5376-54af-4f5e-ac68-2e992a0bf7d5
Nov 07 02:44:17 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:17 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bf5a9215-4690-41a3-96bd-0cd0fe1fd0d5 tempest-CinderUnicodeTest-1933199946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-593c5376-54af-4f5e-ac68-2e992a0bf7d5" returned: 0 in 0.392s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bf5a9215-4690-41a3-96bd-0cd0fe1fd0d5 tempest-CinderUnicodeTest-1933199946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-593c5376-54af-4f5e-ac68-2e992a0bf7d5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:17 devstack sudo[102806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-593c5376-54af-4f5e-ac68-2e992a0bf7d5
Nov 07 02:44:17 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:17 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bf5a9215-4690-41a3-96bd-0cd0fe1fd0d5 tempest-CinderUnicodeTest-1933199946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-593c5376-54af-4f5e-ac68-2e992a0bf7d5" returned: 0 in 0.293s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:17 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-bf5a9215-4690-41a3-96bd-0cd0fe1fd0d5 tempest-CinderUnicodeTest-1933199946 None] Lock "cinder-quobyte-593c5376-54af-4f5e-ac68-2e992a0bf7d5" released by "delete_volume" :: held 0.739s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:17 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-bf5a9215-4690-41a3-96bd-0cd0fe1fd0d5 tempest-CinderUnicodeTest-1933199946 None] Created reservations ['303844cb-3af4-4361-baeb-04b74fb98e1b', '483eaf15-5f72-4fea-b227-dff7f16ef740', 'febe2911-3960-497b-8a89-95ea6218dfc6', 'c100779d-5b67-47dc-aa37-254e38b7f6d4'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:44:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bf5a9215-4690-41a3-96bd-0cd0fe1fd0d5 tempest-CinderUnicodeTest-1933199946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bf5a9215-4690-41a3-96bd-0cd0fe1fd0d5 tempest-CinderUnicodeTest-1933199946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a9215-4690-41a3-96bd-0cd0fe1fd0d5 tempest-CinderUnicodeTest-1933199946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:44:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a9215-4690-41a3-96bd-0cd0fe1fd0d5 tempest-CinderUnicodeTest-1933199946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:44:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bf5a9215-4690-41a3-96bd-0cd0fe1fd0d5 tempest-CinderUnicodeTest-1933199946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bf5a9215-4690-41a3-96bd-0cd0fe1fd0d5 tempest-CinderUnicodeTest-1933199946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:18 devstack sudo[102810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:44:18 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:18 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bf5a9215-4690-41a3-96bd-0cd0fe1fd0d5 tempest-CinderUnicodeTest-1933199946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.510s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:18 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-bf5a9215-4690-41a3-96bd-0cd0fe1fd0d5 tempest-CinderUnicodeTest-1933199946 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:44:18 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-bf5a9215-4690-41a3-96bd-0cd0fe1fd0d5 tempest-CinderUnicodeTest-1933199946 None] Deleted volume successfully.
Nov 07 02:44:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-bf5a9215-4690-41a3-96bd-0cd0fe1fd0d5 tempest-CinderUnicodeTest-1933199946 None] Lock "cinder-593c5376-54af-4f5e-ac68-2e992a0bf7d5-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:24 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Flow 'volume_create_manager' (c228d79f-af5e-41bd-9b97-681d5abcb0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109192dc-52db-45bc-91ae-22ee1d4a3a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109192dc-52db-45bc-91ae-22ee1d4a3a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-40176565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82cfe65-dbb0-42fa-ab97-297d6cce3d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae385c9b158745af928bdd4f4063e082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:44:25Z,use_quota=True,user_id='51052d241d62483dbd8f366791983b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa199ab7-2aa4-4405-b6c5-9a12ba4f13f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa199ab7-2aa4-4405-b6c5-9a12ba4f13f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3040d262-ebef-4631-be80-11f9ee67fed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3040d262-ebef-4631-be80-11f9ee67fed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a82cfe65-dbb0-42fa-ab97-297d6cce3d5b', 'volume_name': 'volume-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15107b0-9e60-4e3f-8760-db681eeca811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15107b0-9e60-4e3f-8760-db681eeca811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f1b428-351e-47c3-9748-7ecdc8a556ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:25 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Volume a82cfe65-dbb0-42fa-ab97-297d6cce3d5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b', 'volume_size': 1}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-40176565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82cfe65-dbb0-42fa-ab97-297d6cce3d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae385c9b158745af928bdd4f4063e082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:44:25Z,use_quota=True,user_id='51052d241d62483dbd8f366791983b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Creating volume a82cfe65-dbb0-42fa-ab97-297d6cce3d5b {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:44:25 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:25 devstack sudo[102935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b 1073741824
Nov 07 02:44:25 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:25 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b 1073741824" returned: 0 in 0.445s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:25 devstack sudo[102940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b
Nov 07 02:44:25 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:25 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b" returned: 0 in 0.246s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f1b428-351e-47c3-9748-7ecdc8a556ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25356b1-1baa-4650-92ca-3337b389778b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:25 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Volume volume-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b (a82cfe65-dbb0-42fa-ab97-297d6cce3d5b): created successfully
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25356b1-1baa-4650-92ca-3337b389778b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Flow 'volume_create_manager' (c228d79f-af5e-41bd-9b97-681d5abcb0cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:44:25 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-5a60e990-b1ee-4860-827a-9986d56ec983 tempest-VolumesActionsTest-1350864631 None] Created volume successfully.
Nov 07 02:44:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5cf47220-94dd-4f1b-adb1-755f58b536ba tempest-VolumesActionsTest-1350864631 None] Acquiring lock "cinder-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b" by "attach_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5cf47220-94dd-4f1b-adb1-755f58b536ba tempest-VolumesActionsTest-1350864631 None] Lock "cinder-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b" acquired by "attach_volume" :: waited 0.025s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:27 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-5cf47220-94dd-4f1b-adb1-755f58b536ba tempest-VolumesActionsTest-1350864631 None] Attaching volume a82cfe65-dbb0-42fa-ab97-297d6cce3d5b to instance 0f798631-f9b3-4a8e-88e6-db616d8e489a at mountpoint /dev/vdb on host None.
Nov 07 02:44:27 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-5cf47220-94dd-4f1b-adb1-755f58b536ba tempest-VolumesActionsTest-1350864631 None] Attach volume completed successfully.
Nov 07 02:44:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5cf47220-94dd-4f1b-adb1-755f58b536ba tempest-VolumesActionsTest-1350864631 None] Lock "cinder-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b" released by "attach_volume" :: held 0.096s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:27 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-9614ac29-bfe9-4b64-9412-1155d2d81db4 tempest-VolumesActionsTest-1618125475 None] Terminate volume connection completed successfully.
Nov 07 02:44:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9614ac29-bfe9-4b64-9412-1155d2d81db4 tempest-VolumesActionsTest-1618125475 None] Acquiring lock "cinder-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b-detach_volume" by "detach_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9614ac29-bfe9-4b64-9412-1155d2d81db4 tempest-VolumesActionsTest-1618125475 None] Lock "cinder-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:28 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-9614ac29-bfe9-4b64-9412-1155d2d81db4 tempest-VolumesActionsTest-1618125475 None] Detaching volume a82cfe65-dbb0-42fa-ab97-297d6cce3d5b from instance 0f798631-f9b3-4a8e-88e6-db616d8e489a.
Nov 07 02:44:28 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-9614ac29-bfe9-4b64-9412-1155d2d81db4 tempest-VolumesActionsTest-1618125475 None] Detach volume completed successfully.
Nov 07 02:44:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9614ac29-bfe9-4b64-9412-1155d2d81db4 tempest-VolumesActionsTest-1618125475 None] Lock "cinder-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-852a902b-400a-4398-8cf9-eec249740d3e tempest-VolumesActionsTest-1350864631 None] Acquiring lock "cinder-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b-detach_volume" by "detach_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-852a902b-400a-4398-8cf9-eec249740d3e tempest-VolumesActionsTest-1350864631 None] Lock "cinder-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:28 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-852a902b-400a-4398-8cf9-eec249740d3e tempest-VolumesActionsTest-1350864631 None] Volume detach called, but volume not attached.
Nov 07 02:44:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-852a902b-400a-4398-8cf9-eec249740d3e tempest-VolumesActionsTest-1350864631 None] Lock "cinder-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b-detach_volume" released by "detach_volume" :: held 0.019s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-42ee721a-b674-490f-b28b-977c9d8dad0e tempest-VolumesActionsTest-1350864631 None] Acquiring lock "cinder-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-42ee721a-b674-490f-b28b-977c9d8dad0e tempest-VolumesActionsTest-1350864631 None] Lock "cinder-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-42ee721a-b674-490f-b28b-977c9d8dad0e tempest-VolumesActionsTest-1350864631 None] Acquiring lock "cinder-quobyte-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-42ee721a-b674-490f-b28b-977c9d8dad0e tempest-VolumesActionsTest-1350864631 None] Lock "cinder-quobyte-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b" acquired by "delete_volume" :: waited 0.025s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:28 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb77fdb-e1a0-441e-bcb1-5b2ec0d53898]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:44:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-42ee721a-b674-490f-b28b-977c9d8dad0e tempest-VolumesActionsTest-1350864631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:28 devstack sudo[102944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b
Nov 07 02:44:28 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:29 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-42ee721a-b674-490f-b28b-977c9d8dad0e tempest-VolumesActionsTest-1350864631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b" returned: 0 in 0.396s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-42ee721a-b674-490f-b28b-977c9d8dad0e tempest-VolumesActionsTest-1350864631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:29 devstack sudo[102949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b
Nov 07 02:44:29 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:29 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-42ee721a-b674-490f-b28b-977c9d8dad0e tempest-VolumesActionsTest-1350864631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b" returned: 0 in 0.280s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:29 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-42ee721a-b674-490f-b28b-977c9d8dad0e tempest-VolumesActionsTest-1350864631 None] Lock "cinder-quobyte-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b" released by "delete_volume" :: held 0.730s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:29 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-42ee721a-b674-490f-b28b-977c9d8dad0e tempest-VolumesActionsTest-1350864631 None] Created reservations ['30d6e438-b611-4442-8ac5-63bc5b47b8ab', '858e2345-21eb-4e44-8592-ff455bc6adb4', 'a1e8ee6a-484b-4ee0-a4b8-04a20c18357f', 'c149f0b4-5362-47de-bdb9-a62483d55c22'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:44:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-42ee721a-b674-490f-b28b-977c9d8dad0e tempest-VolumesActionsTest-1350864631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-42ee721a-b674-490f-b28b-977c9d8dad0e tempest-VolumesActionsTest-1350864631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-42ee721a-b674-490f-b28b-977c9d8dad0e tempest-VolumesActionsTest-1350864631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:44:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-42ee721a-b674-490f-b28b-977c9d8dad0e tempest-VolumesActionsTest-1350864631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:44:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-42ee721a-b674-490f-b28b-977c9d8dad0e tempest-VolumesActionsTest-1350864631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-42ee721a-b674-490f-b28b-977c9d8dad0e tempest-VolumesActionsTest-1350864631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:29 devstack sudo[102961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:44:29 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:29 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-42ee721a-b674-490f-b28b-977c9d8dad0e tempest-VolumesActionsTest-1350864631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.298s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:29 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-42ee721a-b674-490f-b28b-977c9d8dad0e tempest-VolumesActionsTest-1350864631 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:44:29 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-42ee721a-b674-490f-b28b-977c9d8dad0e tempest-VolumesActionsTest-1350864631 None] Deleted volume successfully.
Nov 07 02:44:29 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-42ee721a-b674-490f-b28b-977c9d8dad0e tempest-VolumesActionsTest-1350864631 None] Lock "cinder-a82cfe65-dbb0-42fa-ab97-297d6cce3d5b-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:32 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:44:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Flow 'volume_create_manager' (cb980203-da0e-4e88-a55b-b9c52aa39eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:44:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32553d27-cce8-4745-8c4e-1215a1ce0be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32553d27-cce8-4745-8c4e-1215a1ce0be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-537552423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd53216-f363-432a-9963-4e1d3f88b37e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae385c9b158745af928bdd4f4063e082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:44:33Z,use_quota=True,user_id='51052d241d62483dbd8f366791983b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21677a08-3555-4bd7-a0e4-e7a6680360eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21677a08-3555-4bd7-a0e4-e7a6680360eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c62afb26-949a-440a-b268-d7e0a2a8cdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c62afb26-949a-440a-b268-d7e0a2a8cdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fd53216-f363-432a-9963-4e1d3f88b37e', 'volume_name': 'volume-6fd53216-f363-432a-9963-4e1d3f88b37e', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdbc9453-e35c-479b-af89-58947eb99f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdbc9453-e35c-479b-af89-58947eb99f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db06283-c894-440f-82d2-e6954b11b696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:32 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Volume 6fd53216-f363-432a-9963-4e1d3f88b37e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fd53216-f363-432a-9963-4e1d3f88b37e', 'volume_size': 1}
Nov 07 02:44:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:32 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-537552423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd53216-f363-432a-9963-4e1d3f88b37e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae385c9b158745af928bdd4f4063e082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:44:33Z,use_quota=True,user_id='51052d241d62483dbd8f366791983b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:44:32 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Creating volume 6fd53216-f363-432a-9963-4e1d3f88b37e {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:44:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:32 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:44:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:44:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:44:33 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:44:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6fd53216-f363-432a-9963-4e1d3f88b37e 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:33 devstack sudo[102989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6fd53216-f363-432a-9963-4e1d3f88b37e 1073741824
Nov 07 02:44:33 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:33 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6fd53216-f363-432a-9963-4e1d3f88b37e 1073741824" returned: 0 in 0.409s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6fd53216-f363-432a-9963-4e1d3f88b37e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:33 devstack sudo[102994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6fd53216-f363-432a-9963-4e1d3f88b37e
Nov 07 02:44:33 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:33 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6fd53216-f363-432a-9963-4e1d3f88b37e" returned: 0 in 0.244s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:44:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:33 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db06283-c894-440f-82d2-e6954b11b696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fd53216-f363-432a-9963-4e1d3f88b37e', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:33 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40b46a5-adaf-4410-9d3a-1e06b575216a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:33 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Volume volume-6fd53216-f363-432a-9963-4e1d3f88b37e (6fd53216-f363-432a-9963-4e1d3f88b37e): created successfully
Nov 07 02:44:33 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40b46a5-adaf-4410-9d3a-1e06b575216a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:33 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Flow 'volume_create_manager' (cb980203-da0e-4e88-a55b-b9c52aa39eb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:44:33 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-809e6d22-2cd8-440d-9b2d-580b8139ea21 tempest-VolumesActionsTest-1350864631 None] Created volume successfully.
Nov 07 02:44:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-bfd2d5a3-c7d5-4f80-b385-304d45be4eb9 tempest-VolumesActionsTest-1618125475 None] Acquiring lock "cinder-6fd53216-f363-432a-9963-4e1d3f88b37e-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-bfd2d5a3-c7d5-4f80-b385-304d45be4eb9 tempest-VolumesActionsTest-1618125475 None] Lock "cinder-6fd53216-f363-432a-9963-4e1d3f88b37e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-bfd2d5a3-c7d5-4f80-b385-304d45be4eb9 tempest-VolumesActionsTest-1618125475 None] Acquiring lock "cinder-quobyte-6fd53216-f363-432a-9963-4e1d3f88b37e" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-bfd2d5a3-c7d5-4f80-b385-304d45be4eb9 tempest-VolumesActionsTest-1618125475 None] Lock "cinder-quobyte-6fd53216-f363-432a-9963-4e1d3f88b37e" acquired by "delete_volume" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:34 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ea7bff-bc2a-4d41-8f66-3648d3afe438]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:44:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bfd2d5a3-c7d5-4f80-b385-304d45be4eb9 tempest-VolumesActionsTest-1618125475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6fd53216-f363-432a-9963-4e1d3f88b37e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:34 devstack sudo[102997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6fd53216-f363-432a-9963-4e1d3f88b37e
Nov 07 02:44:34 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:34 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bfd2d5a3-c7d5-4f80-b385-304d45be4eb9 tempest-VolumesActionsTest-1618125475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6fd53216-f363-432a-9963-4e1d3f88b37e" returned: 0 in 0.349s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bfd2d5a3-c7d5-4f80-b385-304d45be4eb9 tempest-VolumesActionsTest-1618125475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6fd53216-f363-432a-9963-4e1d3f88b37e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:34 devstack sudo[103002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6fd53216-f363-432a-9963-4e1d3f88b37e
Nov 07 02:44:34 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:34 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bfd2d5a3-c7d5-4f80-b385-304d45be4eb9 tempest-VolumesActionsTest-1618125475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6fd53216-f363-432a-9963-4e1d3f88b37e" returned: 0 in 0.248s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-bfd2d5a3-c7d5-4f80-b385-304d45be4eb9 tempest-VolumesActionsTest-1618125475 None] Lock "cinder-quobyte-6fd53216-f363-432a-9963-4e1d3f88b37e" released by "delete_volume" :: held 0.641s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:34 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-bfd2d5a3-c7d5-4f80-b385-304d45be4eb9 tempest-VolumesActionsTest-1618125475 None] Created reservations ['5004790e-9c31-485b-b8f7-1e525d535845', '11c41165-51e8-4e5f-a5dd-4824765241e8', 'a0d2b7e2-f559-4117-b410-6914f02b5dfb', '4869d6ca-6b63-4e69-b3fd-8b40a8a9959f'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:44:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bfd2d5a3-c7d5-4f80-b385-304d45be4eb9 tempest-VolumesActionsTest-1618125475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bfd2d5a3-c7d5-4f80-b385-304d45be4eb9 tempest-VolumesActionsTest-1618125475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bfd2d5a3-c7d5-4f80-b385-304d45be4eb9 tempest-VolumesActionsTest-1618125475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:44:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bfd2d5a3-c7d5-4f80-b385-304d45be4eb9 tempest-VolumesActionsTest-1618125475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:44:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bfd2d5a3-c7d5-4f80-b385-304d45be4eb9 tempest-VolumesActionsTest-1618125475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bfd2d5a3-c7d5-4f80-b385-304d45be4eb9 tempest-VolumesActionsTest-1618125475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:34 devstack sudo[103007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:44:34 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:35 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bfd2d5a3-c7d5-4f80-b385-304d45be4eb9 tempest-VolumesActionsTest-1618125475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.247s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-bfd2d5a3-c7d5-4f80-b385-304d45be4eb9 tempest-VolumesActionsTest-1618125475 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:44:35 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-bfd2d5a3-c7d5-4f80-b385-304d45be4eb9 tempest-VolumesActionsTest-1618125475 None] Deleted volume successfully.
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-bfd2d5a3-c7d5-4f80-b385-304d45be4eb9 tempest-VolumesActionsTest-1618125475 None] Lock "cinder-6fd53216-f363-432a-9963-4e1d3f88b37e-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Flow 'volume_create_manager' (a56ba35e-38f0-4e45-9e7f-3674c0f7d316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2e9549-8c46-46c9-b1e8-d1e494553a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2e9549-8c46-46c9-b1e8-d1e494553a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-108371717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae385c9b158745af928bdd4f4063e082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:44:36Z,use_quota=True,user_id='51052d241d62483dbd8f366791983b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d768603c-9080-4dde-b180-58a1db3ca5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d768603c-9080-4dde-b180-58a1db3ca5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c80dc3-5e23-4efa-a015-82f6c5d62e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c80dc3-5e23-4efa-a015-82f6c5d62e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f', 'volume_name': 'volume-2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b6bf74c-b305-4f0b-a27f-7a5db877c6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b6bf74c-b305-4f0b-a27f-7a5db877c6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44cba57b-846a-452e-8f53-48a95090c6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:35 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Volume 2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f', 'volume_size': 1}
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-108371717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae385c9b158745af928bdd4f4063e082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:44:36Z,use_quota=True,user_id='51052d241d62483dbd8f366791983b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Creating volume 2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:44:35 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:44:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:35 devstack sudo[103022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f 1073741824
Nov 07 02:44:35 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-24956267-0093-4cc8-930a-949321ce10b1 req-508885ea-d024-4d5b-9e55-1b33c48a947e tempest-TestInstancesWithCinderVolumes-710842639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:36 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f 1073741824" returned: 0 in 0.425s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:36 devstack sudo[103029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f
Nov 07 02:44:36 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:36 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f" returned: 0 in 0.239s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:44:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-24956267-0093-4cc8-930a-949321ce10b1 req-508885ea-d024-4d5b-9e55-1b33c48a947e tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.580s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-24956267-0093-4cc8-930a-949321ce10b1 req-508885ea-d024-4d5b-9e55-1b33c48a947e tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44cba57b-846a-452e-8f53-48a95090c6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6ccd61-53b8-40ad-b67c-4b73fee60f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:36 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Volume volume-2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f (2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f): created successfully
Nov 07 02:44:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6ccd61-53b8-40ad-b67c-4b73fee60f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Flow 'volume_create_manager' (a56ba35e-38f0-4e45-9e7f-3674c0f7d316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:44:36 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-6e35d7af-54bb-4572-bfbd-384b1760f068 tempest-VolumesActionsTest-1350864631 None] Created volume successfully.
Nov 07 02:44:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-24956267-0093-4cc8-930a-949321ce10b1 req-508885ea-d024-4d5b-9e55-1b33c48a947e tempest-TestInstancesWithCinderVolumes-710842639 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c', 'name': 'volume-617dd0ff-f734-4e0d-bc39-f2e3a9813b97', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad8ff5cf-87be-4580-ae8a-1e45388d4ba4', 'enforce_multipath': True} {{(pid=87054) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:44:36 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-24956267-0093-4cc8-930a-949321ce10b1 req-508885ea-d024-4d5b-9e55-1b33c48a947e tempest-TestInstancesWithCinderVolumes-710842639 None] attachment_update completed successfully.
Nov 07 02:44:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c8009b05-03cf-495e-8395-35497fb669f4 tempest-VolumesActionsTest-1618125475 None] Acquiring lock "cinder-2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c8009b05-03cf-495e-8395-35497fb669f4 tempest-VolumesActionsTest-1618125475 None] Lock "cinder-2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c8009b05-03cf-495e-8395-35497fb669f4 tempest-VolumesActionsTest-1618125475 None] Acquiring lock "cinder-quobyte-2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c8009b05-03cf-495e-8395-35497fb669f4 tempest-VolumesActionsTest-1618125475 None] Lock "cinder-quobyte-2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f" acquired by "delete_volume" :: waited 0.024s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:37 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa449b3-5638-4881-bb5b-da2ac7d04f56]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:44:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c8009b05-03cf-495e-8395-35497fb669f4 tempest-VolumesActionsTest-1618125475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:37 devstack sudo[103034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f
Nov 07 02:44:37 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:37 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c8009b05-03cf-495e-8395-35497fb669f4 tempest-VolumesActionsTest-1618125475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f" returned: 0 in 0.367s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c8009b05-03cf-495e-8395-35497fb669f4 tempest-VolumesActionsTest-1618125475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:37 devstack sudo[103039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f
Nov 07 02:44:37 devstack sudo[103039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:37 devstack sudo[103039]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c8009b05-03cf-495e-8395-35497fb669f4 tempest-VolumesActionsTest-1618125475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f" returned: 0 in 0.251s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c8009b05-03cf-495e-8395-35497fb669f4 tempest-VolumesActionsTest-1618125475 None] Lock "cinder-quobyte-2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f" released by "delete_volume" :: held 0.673s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:37 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-c8009b05-03cf-495e-8395-35497fb669f4 tempest-VolumesActionsTest-1618125475 None] Created reservations ['f29c3fd9-44b3-4933-924d-8bd3cfc9ce83', '1fce73cd-f060-41db-ba40-a7b1be0fa77a', '549929fd-112f-42a6-a642-2bcbdabac9f5', '9ecce590-651e-45c8-bfe1-c1dda040e3d7'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:44:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c8009b05-03cf-495e-8395-35497fb669f4 tempest-VolumesActionsTest-1618125475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c8009b05-03cf-495e-8395-35497fb669f4 tempest-VolumesActionsTest-1618125475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:37 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c8009b05-03cf-495e-8395-35497fb669f4 tempest-VolumesActionsTest-1618125475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:44:37 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c8009b05-03cf-495e-8395-35497fb669f4 tempest-VolumesActionsTest-1618125475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:44:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c8009b05-03cf-495e-8395-35497fb669f4 tempest-VolumesActionsTest-1618125475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c8009b05-03cf-495e-8395-35497fb669f4 tempest-VolumesActionsTest-1618125475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:37 devstack sudo[103042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:44:37 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:38 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c8009b05-03cf-495e-8395-35497fb669f4 tempest-VolumesActionsTest-1618125475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.268s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-c8009b05-03cf-495e-8395-35497fb669f4 tempest-VolumesActionsTest-1618125475 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:44:38 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c8009b05-03cf-495e-8395-35497fb669f4 tempest-VolumesActionsTest-1618125475 None] Deleted volume successfully.
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c8009b05-03cf-495e-8395-35497fb669f4 tempest-VolumesActionsTest-1618125475 None] Lock "cinder-2d05a484-ddd4-487f-bfbe-5c1fc4f5f20f-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Flow 'volume_create_manager' (9cb7d71a-e0f4-473c-af5e-136ec6e2edd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2701c5be-4f0f-449f-a6ce-33322adc239c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2701c5be-4f0f-449f-a6ce-33322adc239c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-931162544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215563f6-8186-45c7-b060-628c85742127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae385c9b158745af928bdd4f4063e082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:44:39Z,use_quota=True,user_id='51052d241d62483dbd8f366791983b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1338189b-09ce-4227-b9e5-9e42b27b8ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1338189b-09ce-4227-b9e5-9e42b27b8ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a18d990-abde-4570-8e72-72688d2f5a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a18d990-abde-4570-8e72-72688d2f5a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '215563f6-8186-45c7-b060-628c85742127', 'volume_name': 'volume-215563f6-8186-45c7-b060-628c85742127', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d4d34d5-2421-4dfa-915a-ce7640c0f0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d4d34d5-2421-4dfa-915a-ce7640c0f0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0408072-b893-432d-8c67-21b61d6cf696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:38 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Volume 215563f6-8186-45c7-b060-628c85742127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-215563f6-8186-45c7-b060-628c85742127', 'volume_size': 1}
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-931162544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215563f6-8186-45c7-b060-628c85742127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae385c9b158745af928bdd4f4063e082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:44:39Z,use_quota=True,user_id='51052d241d62483dbd8f366791983b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Creating volume 215563f6-8186-45c7-b060-628c85742127 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:44:38 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:44:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-215563f6-8186-45c7-b060-628c85742127 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:38 devstack sudo[103055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-215563f6-8186-45c7-b060-628c85742127 1073741824
Nov 07 02:44:38 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-0ad4b5a3-af84-42f2-89be-8a72aef41f64 req-0dc08bff-c6bd-4b7a-9935-4683c65b9bf7 tempest-TestInstancesWithCinderVolumes-710842639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:39 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-215563f6-8186-45c7-b060-628c85742127 1073741824" returned: 0 in 0.464s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-215563f6-8186-45c7-b060-628c85742127 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:39 devstack sudo[103070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-215563f6-8186-45c7-b060-628c85742127
Nov 07 02:44:39 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:39 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-215563f6-8186-45c7-b060-628c85742127" returned: 0 in 0.251s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:44:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-0ad4b5a3-af84-42f2-89be-8a72aef41f64 req-0dc08bff-c6bd-4b7a-9935-4683c65b9bf7 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.415s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-0ad4b5a3-af84-42f2-89be-8a72aef41f64 req-0dc08bff-c6bd-4b7a-9935-4683c65b9bf7 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0408072-b893-432d-8c67-21b61d6cf696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-215563f6-8186-45c7-b060-628c85742127', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3713c7b-710f-419a-97a2-2ed2cfd22b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:39 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Volume volume-215563f6-8186-45c7-b060-628c85742127 (215563f6-8186-45c7-b060-628c85742127): created successfully
Nov 07 02:44:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3713c7b-710f-419a-97a2-2ed2cfd22b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Flow 'volume_create_manager' (9cb7d71a-e0f4-473c-af5e-136ec6e2edd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:44:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-0ad4b5a3-af84-42f2-89be-8a72aef41f64 req-0dc08bff-c6bd-4b7a-9935-4683c65b9bf7 tempest-TestInstancesWithCinderVolumes-710842639 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c', 'name': 'volume-dbcff9e6-24cd-4dc9-adc6-05d7317e26aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e261d41-da97-49d8-b55b-061b69910a40', 'enforce_multipath': True} {{(pid=87054) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:44:39 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b17efb6d-7637-483a-927e-804947809f66 tempest-VolumesActionsTest-1350864631 None] Created volume successfully.
Nov 07 02:44:39 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-0ad4b5a3-af84-42f2-89be-8a72aef41f64 req-0dc08bff-c6bd-4b7a-9935-4683c65b9bf7 tempest-TestInstancesWithCinderVolumes-710842639 None] attachment_update completed successfully.
Nov 07 02:44:40 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6fed4ca4-9400-441e-9666-952ed22fc216 tempest-VolumesActionsTest-1618125475 None] Acquiring lock "cinder-215563f6-8186-45c7-b060-628c85742127-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:40 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6fed4ca4-9400-441e-9666-952ed22fc216 tempest-VolumesActionsTest-1618125475 None] Lock "cinder-215563f6-8186-45c7-b060-628c85742127-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:40 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6fed4ca4-9400-441e-9666-952ed22fc216 tempest-VolumesActionsTest-1618125475 None] Acquiring lock "cinder-quobyte-215563f6-8186-45c7-b060-628c85742127" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:40 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6fed4ca4-9400-441e-9666-952ed22fc216 tempest-VolumesActionsTest-1618125475 None] Lock "cinder-quobyte-215563f6-8186-45c7-b060-628c85742127" acquired by "delete_volume" :: waited 0.013s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:40 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9385488-17af-458e-8651-364210254fa4]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:44:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6fed4ca4-9400-441e-9666-952ed22fc216 tempest-VolumesActionsTest-1618125475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-215563f6-8186-45c7-b060-628c85742127 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:41 devstack sudo[103075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-215563f6-8186-45c7-b060-628c85742127
Nov 07 02:44:41 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:41 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6fed4ca4-9400-441e-9666-952ed22fc216 tempest-VolumesActionsTest-1618125475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-215563f6-8186-45c7-b060-628c85742127" returned: 0 in 0.373s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6fed4ca4-9400-441e-9666-952ed22fc216 tempest-VolumesActionsTest-1618125475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-215563f6-8186-45c7-b060-628c85742127 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:41 devstack sudo[103084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-215563f6-8186-45c7-b060-628c85742127
Nov 07 02:44:41 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:41 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6fed4ca4-9400-441e-9666-952ed22fc216 tempest-VolumesActionsTest-1618125475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-215563f6-8186-45c7-b060-628c85742127" returned: 0 in 0.247s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:41 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6fed4ca4-9400-441e-9666-952ed22fc216 tempest-VolumesActionsTest-1618125475 None] Lock "cinder-quobyte-215563f6-8186-45c7-b060-628c85742127" released by "delete_volume" :: held 0.660s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:41 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-6fed4ca4-9400-441e-9666-952ed22fc216 tempest-VolumesActionsTest-1618125475 None] Created reservations ['7548bf9e-34ab-45b3-b2b2-713ceecb4009', 'd29c5ee6-8309-4bab-b842-e039433242fb', '82fd2795-f5ac-4588-91e7-f2579b055bb3', 'f1021bf8-4d84-4c9f-816b-fa44209bd06c'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:44:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6fed4ca4-9400-441e-9666-952ed22fc216 tempest-VolumesActionsTest-1618125475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6fed4ca4-9400-441e-9666-952ed22fc216 tempest-VolumesActionsTest-1618125475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6fed4ca4-9400-441e-9666-952ed22fc216 tempest-VolumesActionsTest-1618125475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:44:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6fed4ca4-9400-441e-9666-952ed22fc216 tempest-VolumesActionsTest-1618125475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:44:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6fed4ca4-9400-441e-9666-952ed22fc216 tempest-VolumesActionsTest-1618125475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6fed4ca4-9400-441e-9666-952ed22fc216 tempest-VolumesActionsTest-1618125475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:41 devstack sudo[103091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:44:41 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:41 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6fed4ca4-9400-441e-9666-952ed22fc216 tempest-VolumesActionsTest-1618125475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.275s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:41 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6fed4ca4-9400-441e-9666-952ed22fc216 tempest-VolumesActionsTest-1618125475 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:44:42 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-6fed4ca4-9400-441e-9666-952ed22fc216 tempest-VolumesActionsTest-1618125475 None] Deleted volume successfully.
Nov 07 02:44:42 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6fed4ca4-9400-441e-9666-952ed22fc216 tempest-VolumesActionsTest-1618125475 None] Lock "cinder-215563f6-8186-45c7-b060-628c85742127-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:42 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:44:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Flow 'volume_create_manager' (76d4b797-682e-4be1-8dad-e2ddee4b7d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:44:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2fb851-72a7-49db-a0a0-c68d2efe6c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2fb851-72a7-49db-a0a0-c68d2efe6c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-445212230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd0123f8-49b5-4b36-b80a-32707abcbf8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae385c9b158745af928bdd4f4063e082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:44:43Z,use_quota=True,user_id='51052d241d62483dbd8f366791983b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c2ad88-2947-4242-8aea-c931b3e2b6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c2ad88-2947-4242-8aea-c931b3e2b6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa18f05-c6e2-4881-bd73-03c54ded82fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa18f05-c6e2-4881-bd73-03c54ded82fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd0123f8-49b5-4b36-b80a-32707abcbf8d', 'volume_name': 'volume-fd0123f8-49b5-4b36-b80a-32707abcbf8d', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34045725-494d-4599-a0e7-a52ee23a0973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34045725-494d-4599-a0e7-a52ee23a0973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ec094e-7343-4728-9b69-aac1e4482389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:42 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Volume fd0123f8-49b5-4b36-b80a-32707abcbf8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd0123f8-49b5-4b36-b80a-32707abcbf8d', 'volume_size': 1}
Nov 07 02:44:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:42 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-445212230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd0123f8-49b5-4b36-b80a-32707abcbf8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae385c9b158745af928bdd4f4063e082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:44:43Z,use_quota=True,user_id='51052d241d62483dbd8f366791983b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:44:42 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Creating volume fd0123f8-49b5-4b36-b80a-32707abcbf8d {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:44:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:42 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:44:42 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:44:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:42 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:44:42 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:44:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fd0123f8-49b5-4b36-b80a-32707abcbf8d 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:42 devstack sudo[103096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fd0123f8-49b5-4b36-b80a-32707abcbf8d 1073741824
Nov 07 02:44:42 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:43 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fd0123f8-49b5-4b36-b80a-32707abcbf8d 1073741824" returned: 0 in 0.450s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fd0123f8-49b5-4b36-b80a-32707abcbf8d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:43 devstack sudo[103102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fd0123f8-49b5-4b36-b80a-32707abcbf8d
Nov 07 02:44:43 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:43 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fd0123f8-49b5-4b36-b80a-32707abcbf8d" returned: 0 in 0.250s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:44:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ec094e-7343-4728-9b69-aac1e4482389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd0123f8-49b5-4b36-b80a-32707abcbf8d', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ee16e6-44c0-482c-b027-9d695c4246a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:43 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Volume volume-fd0123f8-49b5-4b36-b80a-32707abcbf8d (fd0123f8-49b5-4b36-b80a-32707abcbf8d): created successfully
Nov 07 02:44:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ee16e6-44c0-482c-b027-9d695c4246a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Flow 'volume_create_manager' (76d4b797-682e-4be1-8dad-e2ddee4b7d7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:44:43 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-3a3dfb9a-a301-484e-895f-317bf04d47e4 tempest-VolumesActionsTest-1350864631 None] Created volume successfully.
Nov 07 02:44:43 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-31f339be-62bb-4964-b1d0-28ba2f856cc8 tempest-VolumesActionsTest-1618125475 None] Acquiring lock "cinder-fd0123f8-49b5-4b36-b80a-32707abcbf8d-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:43 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-31f339be-62bb-4964-b1d0-28ba2f856cc8 tempest-VolumesActionsTest-1618125475 None] Lock "cinder-fd0123f8-49b5-4b36-b80a-32707abcbf8d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:43 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-31f339be-62bb-4964-b1d0-28ba2f856cc8 tempest-VolumesActionsTest-1618125475 None] Acquiring lock "cinder-quobyte-fd0123f8-49b5-4b36-b80a-32707abcbf8d" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:43 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-31f339be-62bb-4964-b1d0-28ba2f856cc8 tempest-VolumesActionsTest-1618125475 None] Lock "cinder-quobyte-fd0123f8-49b5-4b36-b80a-32707abcbf8d" acquired by "delete_volume" :: waited 0.018s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:43 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2017682-8acc-491e-97ba-4ab9971212dc]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:44:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-31f339be-62bb-4964-b1d0-28ba2f856cc8 tempest-VolumesActionsTest-1618125475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fd0123f8-49b5-4b36-b80a-32707abcbf8d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:43 devstack sudo[103118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fd0123f8-49b5-4b36-b80a-32707abcbf8d
Nov 07 02:44:43 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:44 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-31f339be-62bb-4964-b1d0-28ba2f856cc8 tempest-VolumesActionsTest-1618125475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fd0123f8-49b5-4b36-b80a-32707abcbf8d" returned: 0 in 0.371s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-31f339be-62bb-4964-b1d0-28ba2f856cc8 tempest-VolumesActionsTest-1618125475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fd0123f8-49b5-4b36-b80a-32707abcbf8d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:44 devstack sudo[103132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fd0123f8-49b5-4b36-b80a-32707abcbf8d
Nov 07 02:44:44 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:44 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-31f339be-62bb-4964-b1d0-28ba2f856cc8 tempest-VolumesActionsTest-1618125475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-fd0123f8-49b5-4b36-b80a-32707abcbf8d" returned: 0 in 0.250s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-31f339be-62bb-4964-b1d0-28ba2f856cc8 tempest-VolumesActionsTest-1618125475 None] Lock "cinder-quobyte-fd0123f8-49b5-4b36-b80a-32707abcbf8d" released by "delete_volume" :: held 0.666s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:44 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-31f339be-62bb-4964-b1d0-28ba2f856cc8 tempest-VolumesActionsTest-1618125475 None] Created reservations ['2f6d2bb5-4702-4018-9f71-68f139f4da26', '400f3755-dc7f-4b3e-bcb7-7c46551400f0', 'f4336d53-e0bf-4813-9d72-242b0a280972', '8f1baeb9-4f6d-4f1c-a972-35cc869c9438'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:44:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-31f339be-62bb-4964-b1d0-28ba2f856cc8 tempest-VolumesActionsTest-1618125475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-31f339be-62bb-4964-b1d0-28ba2f856cc8 tempest-VolumesActionsTest-1618125475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-31f339be-62bb-4964-b1d0-28ba2f856cc8 tempest-VolumesActionsTest-1618125475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:44:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-31f339be-62bb-4964-b1d0-28ba2f856cc8 tempest-VolumesActionsTest-1618125475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:44:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-31f339be-62bb-4964-b1d0-28ba2f856cc8 tempest-VolumesActionsTest-1618125475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-31f339be-62bb-4964-b1d0-28ba2f856cc8 tempest-VolumesActionsTest-1618125475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:44 devstack sudo[103137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:44:44 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:44 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-31f339be-62bb-4964-b1d0-28ba2f856cc8 tempest-VolumesActionsTest-1618125475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.269s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:44 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-31f339be-62bb-4964-b1d0-28ba2f856cc8 tempest-VolumesActionsTest-1618125475 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:44:44 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-31f339be-62bb-4964-b1d0-28ba2f856cc8 tempest-VolumesActionsTest-1618125475 None] Deleted volume successfully.
Nov 07 02:44:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-31f339be-62bb-4964-b1d0-28ba2f856cc8 tempest-VolumesActionsTest-1618125475 None] Lock "cinder-fd0123f8-49b5-4b36-b80a-32707abcbf8d-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:45 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-770723f0-7e90-4434-8417-43adedb50881 req-69c4fd53-a564-4146-ab06-2c64708bd034 tempest-TestInstancesWithCinderVolumes-710842639 None] Terminate volume connection completed successfully.
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-770723f0-7e90-4434-8417-43adedb50881 req-69c4fd53-a564-4146-ab06-2c64708bd034 tempest-TestInstancesWithCinderVolumes-710842639 None] Deleting attachment ad8ff5cf-87be-4580-ae8a-1e45388d4ba4. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Flow 'volume_create_manager' (517dce06-0489-4bf1-b0cb-54342063fe6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b01c3c-01b9-46b1-9dbe-ffbc1a07ac3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b01c3c-01b9-46b1-9dbe-ffbc1a07ac3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-426111995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48371886-0ffb-4cf7-891e-f55a1bbdf9eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae385c9b158745af928bdd4f4063e082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:44:45Z,use_quota=True,user_id='51052d241d62483dbd8f366791983b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98529c38-96da-4e52-8b2f-9546657b9dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98529c38-96da-4e52-8b2f-9546657b9dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab650586-6bd2-4c7a-a18c-76623bb9f1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab650586-6bd2-4c7a-a18c-76623bb9f1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48371886-0ffb-4cf7-891e-f55a1bbdf9eb', 'volume_name': 'volume-48371886-0ffb-4cf7-891e-f55a1bbdf9eb', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c63dcae-2ca5-4883-bdfd-d7f245c9e5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c63dcae-2ca5-4883-bdfd-d7f245c9e5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a2d857-5bb8-4bf5-b17f-c0de74d3203b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:45 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Volume 48371886-0ffb-4cf7-891e-f55a1bbdf9eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48371886-0ffb-4cf7-891e-f55a1bbdf9eb', 'volume_size': 1}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-426111995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48371886-0ffb-4cf7-891e-f55a1bbdf9eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae385c9b158745af928bdd4f4063e082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:44:45Z,use_quota=True,user_id='51052d241d62483dbd8f366791983b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Creating volume 48371886-0ffb-4cf7-891e-f55a1bbdf9eb {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:44:45 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-48371886-0ffb-4cf7-891e-f55a1bbdf9eb 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:45 devstack sudo[103142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-48371886-0ffb-4cf7-891e-f55a1bbdf9eb 1073741824
Nov 07 02:44:45 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c8034b57-03c6-4acb-9459-b30093a911cc tempest-TestInstancesWithCinderVolumes-710842639 None] Acquiring lock "cinder-617dd0ff-f734-4e0d-bc39-f2e3a9813b97-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c8034b57-03c6-4acb-9459-b30093a911cc tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "cinder-617dd0ff-f734-4e0d-bc39-f2e3a9813b97-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c8034b57-03c6-4acb-9459-b30093a911cc tempest-TestInstancesWithCinderVolumes-710842639 None] Acquiring lock "cinder-quobyte-617dd0ff-f734-4e0d-bc39-f2e3a9813b97" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c8034b57-03c6-4acb-9459-b30093a911cc tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "cinder-quobyte-617dd0ff-f734-4e0d-bc39-f2e3a9813b97" acquired by "delete_volume" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f559470-ca8d-4891-9597-eca237027d58]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:44:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c8034b57-03c6-4acb-9459-b30093a911cc tempest-TestInstancesWithCinderVolumes-710842639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-617dd0ff-f734-4e0d-bc39-f2e3a9813b97 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:46 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-48371886-0ffb-4cf7-891e-f55a1bbdf9eb 1073741824" returned: 0 in 0.540s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-48371886-0ffb-4cf7-891e-f55a1bbdf9eb {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:46 devstack sudo[103154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-48371886-0ffb-4cf7-891e-f55a1bbdf9eb
Nov 07 02:44:46 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:46 devstack sudo[103153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-617dd0ff-f734-4e0d-bc39-f2e3a9813b97
Nov 07 02:44:46 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:46 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-48371886-0ffb-4cf7-891e-f55a1bbdf9eb" returned: 0 in 0.307s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:44:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a2d857-5bb8-4bf5-b17f-c0de74d3203b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48371886-0ffb-4cf7-891e-f55a1bbdf9eb', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa2e4ac7-7627-4306-8d0e-51da92c23ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:44:46 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Volume volume-48371886-0ffb-4cf7-891e-f55a1bbdf9eb (48371886-0ffb-4cf7-891e-f55a1bbdf9eb): created successfully
Nov 07 02:44:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa2e4ac7-7627-4306-8d0e-51da92c23ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:44:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Flow 'volume_create_manager' (517dce06-0489-4bf1-b0cb-54342063fe6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:44:46 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-1e8075fd-3088-4c50-9d0b-6e843a653ae8 tempest-VolumesActionsTest-1350864631 None] Created volume successfully.
Nov 07 02:44:46 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c8034b57-03c6-4acb-9459-b30093a911cc tempest-TestInstancesWithCinderVolumes-710842639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-617dd0ff-f734-4e0d-bc39-f2e3a9813b97" returned: 0 in 0.477s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c8034b57-03c6-4acb-9459-b30093a911cc tempest-TestInstancesWithCinderVolumes-710842639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-617dd0ff-f734-4e0d-bc39-f2e3a9813b97 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:46 devstack sudo[103161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-617dd0ff-f734-4e0d-bc39-f2e3a9813b97
Nov 07 02:44:46 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:46 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c8034b57-03c6-4acb-9459-b30093a911cc tempest-TestInstancesWithCinderVolumes-710842639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-617dd0ff-f734-4e0d-bc39-f2e3a9813b97" returned: 0 in 0.263s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c8034b57-03c6-4acb-9459-b30093a911cc tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "cinder-quobyte-617dd0ff-f734-4e0d-bc39-f2e3a9813b97" released by "delete_volume" :: held 0.788s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:46 devstack cinder-volume[87054]: WARNING cinder.quota [None req-c8034b57-03c6-4acb-9459-b30093a911cc tempest-TestInstancesWithCinderVolumes-710842639 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1447461311-1758618168 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1447461311-1758618168, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:44:46 devstack cinder-volume[87054]: WARNING cinder.quota [None req-c8034b57-03c6-4acb-9459-b30093a911cc tempest-TestInstancesWithCinderVolumes-710842639 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1447461311-1758618168 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1447461311-1758618168, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:44:46 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-c8034b57-03c6-4acb-9459-b30093a911cc tempest-TestInstancesWithCinderVolumes-710842639 None] Created reservations ['ea27bab6-24e5-40c7-8cdd-192ce07c68a6', 'ea123581-7ccc-40c2-9eb6-1c447dcd4fd9', 'e91df9fe-84f2-45bf-a8b1-0c4c39c2d4bc', '31493f4d-fc1f-47e9-ba42-8f6ca857254a'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:44:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c8034b57-03c6-4acb-9459-b30093a911cc tempest-TestInstancesWithCinderVolumes-710842639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c8034b57-03c6-4acb-9459-b30093a911cc tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c8034b57-03c6-4acb-9459-b30093a911cc tempest-TestInstancesWithCinderVolumes-710842639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:44:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c8034b57-03c6-4acb-9459-b30093a911cc tempest-TestInstancesWithCinderVolumes-710842639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:44:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c8034b57-03c6-4acb-9459-b30093a911cc tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c8034b57-03c6-4acb-9459-b30093a911cc tempest-TestInstancesWithCinderVolumes-710842639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:46 devstack sudo[103164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:44:46 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:47 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c8034b57-03c6-4acb-9459-b30093a911cc tempest-TestInstancesWithCinderVolumes-710842639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.254s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:47 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-c8034b57-03c6-4acb-9459-b30093a911cc tempest-TestInstancesWithCinderVolumes-710842639 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:44:47 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c8034b57-03c6-4acb-9459-b30093a911cc tempest-TestInstancesWithCinderVolumes-710842639 None] Deleted volume successfully.
Nov 07 02:44:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c8034b57-03c6-4acb-9459-b30093a911cc tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "cinder-617dd0ff-f734-4e0d-bc39-f2e3a9813b97-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-99bc2e07-d7ff-4bcb-b3b7-df27f5716900 tempest-VolumesActionsTest-1350864631 None] Acquiring lock "cinder-48371886-0ffb-4cf7-891e-f55a1bbdf9eb-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-99bc2e07-d7ff-4bcb-b3b7-df27f5716900 tempest-VolumesActionsTest-1350864631 None] Lock "cinder-48371886-0ffb-4cf7-891e-f55a1bbdf9eb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-99bc2e07-d7ff-4bcb-b3b7-df27f5716900 tempest-VolumesActionsTest-1350864631 None] Acquiring lock "cinder-quobyte-48371886-0ffb-4cf7-891e-f55a1bbdf9eb" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-99bc2e07-d7ff-4bcb-b3b7-df27f5716900 tempest-VolumesActionsTest-1350864631 None] Lock "cinder-quobyte-48371886-0ffb-4cf7-891e-f55a1bbdf9eb" acquired by "delete_volume" :: waited 0.027s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:48 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec88d7e-3451-4b9e-87d9-e8824dfc657b]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:44:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-99bc2e07-d7ff-4bcb-b3b7-df27f5716900 tempest-VolumesActionsTest-1350864631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-48371886-0ffb-4cf7-891e-f55a1bbdf9eb {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:48 devstack sudo[103177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-48371886-0ffb-4cf7-891e-f55a1bbdf9eb
Nov 07 02:44:48 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:48 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-99bc2e07-d7ff-4bcb-b3b7-df27f5716900 tempest-VolumesActionsTest-1350864631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-48371886-0ffb-4cf7-891e-f55a1bbdf9eb" returned: 0 in 0.366s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-99bc2e07-d7ff-4bcb-b3b7-df27f5716900 tempest-VolumesActionsTest-1350864631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-48371886-0ffb-4cf7-891e-f55a1bbdf9eb {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:48 devstack sudo[103190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-48371886-0ffb-4cf7-891e-f55a1bbdf9eb
Nov 07 02:44:48 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:48 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-99bc2e07-d7ff-4bcb-b3b7-df27f5716900 tempest-VolumesActionsTest-1350864631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-48371886-0ffb-4cf7-891e-f55a1bbdf9eb" returned: 0 in 0.253s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-99bc2e07-d7ff-4bcb-b3b7-df27f5716900 tempest-VolumesActionsTest-1350864631 None] Lock "cinder-quobyte-48371886-0ffb-4cf7-891e-f55a1bbdf9eb" released by "delete_volume" :: held 0.671s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:48 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-99bc2e07-d7ff-4bcb-b3b7-df27f5716900 tempest-VolumesActionsTest-1350864631 None] Created reservations ['6d4da4ab-e448-429e-b14d-4c06e7807ad2', 'a53c1db5-a39f-409b-bb84-684cee295be0', 'e01cdf74-2720-4966-8169-cd99af9583be', '6ff0ce23-44f9-4863-a786-051efa2cf6cc'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:44:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-99bc2e07-d7ff-4bcb-b3b7-df27f5716900 tempest-VolumesActionsTest-1350864631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-99bc2e07-d7ff-4bcb-b3b7-df27f5716900 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:49 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-99bc2e07-d7ff-4bcb-b3b7-df27f5716900 tempest-VolumesActionsTest-1350864631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:44:49 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-99bc2e07-d7ff-4bcb-b3b7-df27f5716900 tempest-VolumesActionsTest-1350864631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:44:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-99bc2e07-d7ff-4bcb-b3b7-df27f5716900 tempest-VolumesActionsTest-1350864631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-99bc2e07-d7ff-4bcb-b3b7-df27f5716900 tempest-VolumesActionsTest-1350864631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:49 devstack sudo[103197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:44:49 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:49 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-99bc2e07-d7ff-4bcb-b3b7-df27f5716900 tempest-VolumesActionsTest-1350864631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.288s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:49 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-99bc2e07-d7ff-4bcb-b3b7-df27f5716900 tempest-VolumesActionsTest-1350864631 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:44:49 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-99bc2e07-d7ff-4bcb-b3b7-df27f5716900 tempest-VolumesActionsTest-1350864631 None] Deleted volume successfully.
Nov 07 02:44:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-99bc2e07-d7ff-4bcb-b3b7-df27f5716900 tempest-VolumesActionsTest-1350864631 None] Lock "cinder-48371886-0ffb-4cf7-891e-f55a1bbdf9eb-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:49 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-cc61bf07-80ed-4764-a9b3-9a206f18c572 req-3524c13d-9874-488d-b5e9-9f3299a2f206 tempest-TestInstancesWithCinderVolumes-710842639 None] Terminate volume connection completed successfully.
Nov 07 02:44:49 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-cc61bf07-80ed-4764-a9b3-9a206f18c572 req-3524c13d-9874-488d-b5e9-9f3299a2f206 tempest-TestInstancesWithCinderVolumes-710842639 None] Deleting attachment 2e261d41-da97-49d8-b55b-061b69910a40. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:44:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d1c41bfe-8139-42b0-9891-0b59ac54a1e6 tempest-TestInstancesWithCinderVolumes-710842639 None] Acquiring lock "cinder-dbcff9e6-24cd-4dc9-adc6-05d7317e26aa-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d1c41bfe-8139-42b0-9891-0b59ac54a1e6 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "cinder-dbcff9e6-24cd-4dc9-adc6-05d7317e26aa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d1c41bfe-8139-42b0-9891-0b59ac54a1e6 tempest-TestInstancesWithCinderVolumes-710842639 None] Acquiring lock "cinder-quobyte-dbcff9e6-24cd-4dc9-adc6-05d7317e26aa" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d1c41bfe-8139-42b0-9891-0b59ac54a1e6 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "cinder-quobyte-dbcff9e6-24cd-4dc9-adc6-05d7317e26aa" acquired by "delete_volume" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:50 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d898e6-23aa-4711-81f6-759140ab8e42]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:44:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d1c41bfe-8139-42b0-9891-0b59ac54a1e6 tempest-TestInstancesWithCinderVolumes-710842639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dbcff9e6-24cd-4dc9-adc6-05d7317e26aa {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:50 devstack sudo[103202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dbcff9e6-24cd-4dc9-adc6-05d7317e26aa
Nov 07 02:44:50 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:50 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d1c41bfe-8139-42b0-9891-0b59ac54a1e6 tempest-TestInstancesWithCinderVolumes-710842639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dbcff9e6-24cd-4dc9-adc6-05d7317e26aa" returned: 0 in 0.430s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d1c41bfe-8139-42b0-9891-0b59ac54a1e6 tempest-TestInstancesWithCinderVolumes-710842639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dbcff9e6-24cd-4dc9-adc6-05d7317e26aa {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:50 devstack sudo[103208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dbcff9e6-24cd-4dc9-adc6-05d7317e26aa
Nov 07 02:44:50 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:51 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d1c41bfe-8139-42b0-9891-0b59ac54a1e6 tempest-TestInstancesWithCinderVolumes-710842639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dbcff9e6-24cd-4dc9-adc6-05d7317e26aa" returned: 0 in 0.289s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d1c41bfe-8139-42b0-9891-0b59ac54a1e6 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "cinder-quobyte-dbcff9e6-24cd-4dc9-adc6-05d7317e26aa" released by "delete_volume" :: held 0.775s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:51 devstack cinder-volume[87054]: WARNING cinder.quota [None req-d1c41bfe-8139-42b0-9891-0b59ac54a1e6 tempest-TestInstancesWithCinderVolumes-710842639 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1563160299-1291746860 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1563160299-1291746860, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:44:51 devstack cinder-volume[87054]: WARNING cinder.quota [None req-d1c41bfe-8139-42b0-9891-0b59ac54a1e6 tempest-TestInstancesWithCinderVolumes-710842639 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1563160299-1291746860 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1563160299-1291746860, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:44:51 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-d1c41bfe-8139-42b0-9891-0b59ac54a1e6 tempest-TestInstancesWithCinderVolumes-710842639 None] Created reservations ['3ef72863-adfe-4651-a25d-fac3578c2796', 'cd870dec-342c-4932-83cd-fcd038cb09fd', '44fb89a2-6983-45eb-b0bb-ec21991064ad', '61eb52f0-02a1-4310-9700-87f8d27cf50f'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:44:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d1c41bfe-8139-42b0-9891-0b59ac54a1e6 tempest-TestInstancesWithCinderVolumes-710842639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d1c41bfe-8139-42b0-9891-0b59ac54a1e6 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:51 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d1c41bfe-8139-42b0-9891-0b59ac54a1e6 tempest-TestInstancesWithCinderVolumes-710842639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:44:51 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d1c41bfe-8139-42b0-9891-0b59ac54a1e6 tempest-TestInstancesWithCinderVolumes-710842639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:44:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d1c41bfe-8139-42b0-9891-0b59ac54a1e6 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d1c41bfe-8139-42b0-9891-0b59ac54a1e6 tempest-TestInstancesWithCinderVolumes-710842639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:51 devstack sudo[103211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:44:51 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:51 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d1c41bfe-8139-42b0-9891-0b59ac54a1e6 tempest-TestInstancesWithCinderVolumes-710842639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.289s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:51 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-d1c41bfe-8139-42b0-9891-0b59ac54a1e6 tempest-TestInstancesWithCinderVolumes-710842639 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:44:51 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-d1c41bfe-8139-42b0-9891-0b59ac54a1e6 tempest-TestInstancesWithCinderVolumes-710842639 None] Deleted volume successfully.
Nov 07 02:44:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-d1c41bfe-8139-42b0-9891-0b59ac54a1e6 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "cinder-dbcff9e6-24cd-4dc9-adc6-05d7317e26aa-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:54 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-dfd15f78-8d98-4f29-80d5-36391fff20d8 req-9c84fa77-9d96-43b5-b0bd-bad014c76ac2 tempest-TestInstancesWithCinderVolumes-710842639 None] Terminate volume connection completed successfully.
Nov 07 02:44:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-dfd15f78-8d98-4f29-80d5-36391fff20d8 req-9c84fa77-9d96-43b5-b0bd-bad014c76ac2 tempest-TestInstancesWithCinderVolumes-710842639 None] Deleting attachment 01db7c44-5d96-4ab6-8647-4d44ddf43632. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:44:55 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-376c1b6e-2d27-4b5d-94d6-d1a1342f8d18 tempest-TestInstancesWithCinderVolumes-710842639 None] Acquiring lock "cinder-d0e6337d-4476-4455-baae-2e91276589af-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:55 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-376c1b6e-2d27-4b5d-94d6-d1a1342f8d18 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "cinder-d0e6337d-4476-4455-baae-2e91276589af-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:55 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-376c1b6e-2d27-4b5d-94d6-d1a1342f8d18 tempest-TestInstancesWithCinderVolumes-710842639 None] Acquiring lock "cinder-quobyte-d0e6337d-4476-4455-baae-2e91276589af" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:44:55 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-376c1b6e-2d27-4b5d-94d6-d1a1342f8d18 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "cinder-quobyte-d0e6337d-4476-4455-baae-2e91276589af" acquired by "delete_volume" :: waited 0.025s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:44:55 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[662fa368-3237-4e13-9c5e-eca39a17982c]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:44:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-376c1b6e-2d27-4b5d-94d6-d1a1342f8d18 tempest-TestInstancesWithCinderVolumes-710842639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0e6337d-4476-4455-baae-2e91276589af {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:55 devstack sudo[103244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0e6337d-4476-4455-baae-2e91276589af
Nov 07 02:44:55 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:56 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-376c1b6e-2d27-4b5d-94d6-d1a1342f8d18 tempest-TestInstancesWithCinderVolumes-710842639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0e6337d-4476-4455-baae-2e91276589af" returned: 0 in 0.390s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-376c1b6e-2d27-4b5d-94d6-d1a1342f8d18 tempest-TestInstancesWithCinderVolumes-710842639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0e6337d-4476-4455-baae-2e91276589af {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:56 devstack sudo[103249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0e6337d-4476-4455-baae-2e91276589af
Nov 07 02:44:56 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:56 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-376c1b6e-2d27-4b5d-94d6-d1a1342f8d18 tempest-TestInstancesWithCinderVolumes-710842639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0e6337d-4476-4455-baae-2e91276589af" returned: 0 in 0.247s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:56 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-376c1b6e-2d27-4b5d-94d6-d1a1342f8d18 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "cinder-quobyte-d0e6337d-4476-4455-baae-2e91276589af" released by "delete_volume" :: held 0.703s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:56 devstack cinder-volume[87054]: WARNING cinder.quota [None req-376c1b6e-2d27-4b5d-94d6-d1a1342f8d18 tempest-TestInstancesWithCinderVolumes-710842639 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-84904880-1303923114 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-84904880-1303923114, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:44:56 devstack cinder-volume[87054]: WARNING cinder.quota [None req-376c1b6e-2d27-4b5d-94d6-d1a1342f8d18 tempest-TestInstancesWithCinderVolumes-710842639 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-84904880-1303923114 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-84904880-1303923114, it is now deprecated. Please use the default quota class for default quota.
Nov 07 02:44:56 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-376c1b6e-2d27-4b5d-94d6-d1a1342f8d18 tempest-TestInstancesWithCinderVolumes-710842639 None] Created reservations ['62f5ee61-1ae5-4b15-939d-37f68971eb20', '59cc7487-9e3f-45b5-bba9-6799a0a99cf9', 'c02e02f6-683f-4ccb-a8f7-a548fabe104b', '3ff4384d-d540-4611-81a2-696fd8cc97cf'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:44:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-376c1b6e-2d27-4b5d-94d6-d1a1342f8d18 tempest-TestInstancesWithCinderVolumes-710842639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-376c1b6e-2d27-4b5d-94d6-d1a1342f8d18 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:56 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-376c1b6e-2d27-4b5d-94d6-d1a1342f8d18 tempest-TestInstancesWithCinderVolumes-710842639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:44:56 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-376c1b6e-2d27-4b5d-94d6-d1a1342f8d18 tempest-TestInstancesWithCinderVolumes-710842639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:44:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-376c1b6e-2d27-4b5d-94d6-d1a1342f8d18 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-376c1b6e-2d27-4b5d-94d6-d1a1342f8d18 tempest-TestInstancesWithCinderVolumes-710842639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:56 devstack sudo[103252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:44:56 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:56 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-376c1b6e-2d27-4b5d-94d6-d1a1342f8d18 tempest-TestInstancesWithCinderVolumes-710842639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.284s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:56 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-376c1b6e-2d27-4b5d-94d6-d1a1342f8d18 tempest-TestInstancesWithCinderVolumes-710842639 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:44:56 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-376c1b6e-2d27-4b5d-94d6-d1a1342f8d18 tempest-TestInstancesWithCinderVolumes-710842639 None] Deleted volume successfully.
Nov 07 02:44:56 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-376c1b6e-2d27-4b5d-94d6-d1a1342f8d18 tempest-TestInstancesWithCinderVolumes-710842639 None] Lock "cinder-d0e6337d-4476-4455-baae-2e91276589af-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:44:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:44:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:44:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:44:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:44:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:44:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:44:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:44:59 devstack sudo[103257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:44:59 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:44:59 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root
Nov 07 02:44:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.294s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:44:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:44:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:44:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 28 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:44:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>, <Thread(fd_logger, started daemon 125443282798592)>, <Thread(privsep_reader, started daemon 125443284556288)>, <Thread(tpool_thread_0, started daemon 125443276445376)>, <Thread(tpool_thread_1, started daemon 125443268036288)>, <Thread(tpool_thread_2, started daemon 125443259627200)>, <Thread(tpool_thread_3, started daemon 125443251218112)>, <Thread(tpool_thread_4, started daemon 125443242809024)>, <Thread(tpool_thread_5, started daemon 125443234399936)>, <Thread(tpool_thread_6, started daemon 125443225990848)>, <Thread(tpool_thread_7, started daemon 125443217581760)>, <Thread(tpool_thread_8, started daemon 125443209172672)>, <Thread(tpool_thread_9, started daemon 125443200763584)>, <Thread(tpool_thread_10, started daemon 125443192354496)>, <Thread(tpool_thread_11, started daemon 125443183945408)>, <Thread(tpool_thread_12, started daemon 125443175536320)>, <Thread(tpool_thread_13, started daemon 125443167127232)>, <Thread(tpool_thread_14, started daemon 125443158718144)>, <Thread(tpool_thread_15, started daemon 125443150309056)>, <Thread(tpool_thread_16, started daemon 125443141899968)>, <Thread(tpool_thread_17, started daemon 125443133490880)>, <Thread(tpool_thread_18, started daemon 125443125081792)>, <Thread(tpool_thread_19, started daemon 125443116672704)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:45:04 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:45:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Flow 'volume_create_manager' (4175b0db-beee-43fe-921c-0ffb83e50866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08043865-34a5-4d50-b546-a820a9d4f924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08043865-34a5-4d50-b546-a820a9d4f924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1334953794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d363f3-84d6-40d3-952a-c8bd79fad582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03907cb032c742239b6074b7f8d7edf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:05Z,use_quota=True,user_id='6d3b35aecbf64343b051b1526015a8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b5eeb6-84f6-425a-87fa-77a193aa9601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b5eeb6-84f6-425a-87fa-77a193aa9601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe3e719-69e6-4a7f-82a6-90b73a7a4af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe3e719-69e6-4a7f-82a6-90b73a7a4af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47d363f3-84d6-40d3-952a-c8bd79fad582', 'volume_name': 'volume-47d363f3-84d6-40d3-952a-c8bd79fad582', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6631138-79a3-4772-a459-450abd8a1e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6631138-79a3-4772-a459-450abd8a1e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77be6e81-ae2f-4384-8058-d224fccf1f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:04 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Volume 47d363f3-84d6-40d3-952a-c8bd79fad582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47d363f3-84d6-40d3-952a-c8bd79fad582', 'volume_size': 1}
Nov 07 02:45:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1334953794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d363f3-84d6-40d3-952a-c8bd79fad582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03907cb032c742239b6074b7f8d7edf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:05Z,use_quota=True,user_id='6d3b35aecbf64343b051b1526015a8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:45:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Creating volume 47d363f3-84d6-40d3-952a-c8bd79fad582 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:45:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:45:04 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:45:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47d363f3-84d6-40d3-952a-c8bd79fad582 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:04 devstack sudo[103303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47d363f3-84d6-40d3-952a-c8bd79fad582 1073741824
Nov 07 02:45:04 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:05 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47d363f3-84d6-40d3-952a-c8bd79fad582 1073741824" returned: 0 in 0.415s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47d363f3-84d6-40d3-952a-c8bd79fad582 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:05 devstack sudo[103309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47d363f3-84d6-40d3-952a-c8bd79fad582
Nov 07 02:45:05 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:05 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47d363f3-84d6-40d3-952a-c8bd79fad582" returned: 0 in 0.289s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:45:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77be6e81-ae2f-4384-8058-d224fccf1f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47d363f3-84d6-40d3-952a-c8bd79fad582', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba805fa-634f-479a-9c00-d19908714e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:05 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Volume volume-47d363f3-84d6-40d3-952a-c8bd79fad582 (47d363f3-84d6-40d3-952a-c8bd79fad582): created successfully
Nov 07 02:45:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba805fa-634f-479a-9c00-d19908714e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Flow 'volume_create_manager' (4175b0db-beee-43fe-921c-0ffb83e50866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:05 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-3442caf6-ea38-4be1-9e05-6acacad0aa95 tempest-AbsoluteLimitsTests-264230910 None] Created volume successfully.
Nov 07 02:45:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e5fe9e1f-5ece-48aa-91ee-700e97a0dbf0 tempest-AbsoluteLimitsTests-264230910 None] Acquiring lock "cinder-47d363f3-84d6-40d3-952a-c8bd79fad582-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:45:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e5fe9e1f-5ece-48aa-91ee-700e97a0dbf0 tempest-AbsoluteLimitsTests-264230910 None] Lock "cinder-47d363f3-84d6-40d3-952a-c8bd79fad582-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:45:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e5fe9e1f-5ece-48aa-91ee-700e97a0dbf0 tempest-AbsoluteLimitsTests-264230910 None] Acquiring lock "cinder-quobyte-47d363f3-84d6-40d3-952a-c8bd79fad582" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:45:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e5fe9e1f-5ece-48aa-91ee-700e97a0dbf0 tempest-AbsoluteLimitsTests-264230910 None] Lock "cinder-quobyte-47d363f3-84d6-40d3-952a-c8bd79fad582" acquired by "delete_volume" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:45:07 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b54a3b-38b2-4b9e-a794-658ceb8e951f]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:45:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e5fe9e1f-5ece-48aa-91ee-700e97a0dbf0 tempest-AbsoluteLimitsTests-264230910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47d363f3-84d6-40d3-952a-c8bd79fad582 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:07 devstack sudo[103313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47d363f3-84d6-40d3-952a-c8bd79fad582
Nov 07 02:45:07 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:07 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e5fe9e1f-5ece-48aa-91ee-700e97a0dbf0 tempest-AbsoluteLimitsTests-264230910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47d363f3-84d6-40d3-952a-c8bd79fad582" returned: 0 in 0.385s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e5fe9e1f-5ece-48aa-91ee-700e97a0dbf0 tempest-AbsoluteLimitsTests-264230910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47d363f3-84d6-40d3-952a-c8bd79fad582 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:07 devstack sudo[103318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47d363f3-84d6-40d3-952a-c8bd79fad582
Nov 07 02:45:07 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:07 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e5fe9e1f-5ece-48aa-91ee-700e97a0dbf0 tempest-AbsoluteLimitsTests-264230910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-47d363f3-84d6-40d3-952a-c8bd79fad582" returned: 0 in 0.264s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e5fe9e1f-5ece-48aa-91ee-700e97a0dbf0 tempest-AbsoluteLimitsTests-264230910 None] Lock "cinder-quobyte-47d363f3-84d6-40d3-952a-c8bd79fad582" released by "delete_volume" :: held 0.693s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:45:07 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-e5fe9e1f-5ece-48aa-91ee-700e97a0dbf0 tempest-AbsoluteLimitsTests-264230910 None] Created reservations ['66249cd3-8cbd-4cc3-8b62-bea768f14712', '25dc3803-45f4-47c1-9445-cee6fbeea32a', '49b01b1a-b546-4ae4-82bd-ab9ef6dc0068', 'f8b314de-3718-4512-9392-daf394fda23b'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:45:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e5fe9e1f-5ece-48aa-91ee-700e97a0dbf0 tempest-AbsoluteLimitsTests-264230910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e5fe9e1f-5ece-48aa-91ee-700e97a0dbf0 tempest-AbsoluteLimitsTests-264230910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e5fe9e1f-5ece-48aa-91ee-700e97a0dbf0 tempest-AbsoluteLimitsTests-264230910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e5fe9e1f-5ece-48aa-91ee-700e97a0dbf0 tempest-AbsoluteLimitsTests-264230910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e5fe9e1f-5ece-48aa-91ee-700e97a0dbf0 tempest-AbsoluteLimitsTests-264230910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e5fe9e1f-5ece-48aa-91ee-700e97a0dbf0 tempest-AbsoluteLimitsTests-264230910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:08 devstack sudo[103322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:45:08 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:08 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e5fe9e1f-5ece-48aa-91ee-700e97a0dbf0 tempest-AbsoluteLimitsTests-264230910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.296s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:08 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-e5fe9e1f-5ece-48aa-91ee-700e97a0dbf0 tempest-AbsoluteLimitsTests-264230910 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:45:08 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-e5fe9e1f-5ece-48aa-91ee-700e97a0dbf0 tempest-AbsoluteLimitsTests-264230910 None] Deleted volume successfully.
Nov 07 02:45:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e5fe9e1f-5ece-48aa-91ee-700e97a0dbf0 tempest-AbsoluteLimitsTests-264230910 None] Lock "cinder-47d363f3-84d6-40d3-952a-c8bd79fad582-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Flow 'volume_create_manager' (f94f3274-3372-4f2b-aad2-9c599b5c68d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667b9c89-51c2-47f2-adab-f94030834595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667b9c89-51c2-47f2-adab-f94030834595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1178751646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08497f88-a0d7-443f-b496-34f27f592022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dd21c6ceafc451ebcf5fd873ee574b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:13Z,use_quota=True,user_id='61c294741b014f05ab765fa4f21d3400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74009520-2cf5-43f1-85bb-61e9315db781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74009520-2cf5-43f1-85bb-61e9315db781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca3d1f04-f440-4ed0-a9c7-b236c8b308b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca3d1f04-f440-4ed0-a9c7-b236c8b308b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08497f88-a0d7-443f-b496-34f27f592022', 'volume_name': 'volume-08497f88-a0d7-443f-b496-34f27f592022', 'volume_size': 2}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0531b460-c1a2-4e27-9c92-a12c0cedc141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0531b460-c1a2-4e27-9c92-a12c0cedc141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e844a670-d664-4e9f-b1e3-c11188245759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:13 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Volume 08497f88-a0d7-443f-b496-34f27f592022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08497f88-a0d7-443f-b496-34f27f592022', 'volume_size': 2}
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1178751646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08497f88-a0d7-443f-b496-34f27f592022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dd21c6ceafc451ebcf5fd873ee574b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:13Z,use_quota=True,user_id='61c294741b014f05ab765fa4f21d3400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Creating volume 08497f88-a0d7-443f-b496-34f27f592022 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:45:13 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08497f88-a0d7-443f-b496-34f27f592022 2147483648 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:13 devstack sudo[103325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08497f88-a0d7-443f-b496-34f27f592022 2147483648
Nov 07 02:45:13 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:13 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08497f88-a0d7-443f-b496-34f27f592022 2147483648" returned: 0 in 0.482s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08497f88-a0d7-443f-b496-34f27f592022 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:13 devstack sudo[103331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08497f88-a0d7-443f-b496-34f27f592022
Nov 07 02:45:13 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:14 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08497f88-a0d7-443f-b496-34f27f592022" returned: 0 in 0.263s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:45:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e844a670-d664-4e9f-b1e3-c11188245759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08497f88-a0d7-443f-b496-34f27f592022', 'volume_size': 2}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e94ac42-7f84-4ce1-8f6e-62e1b637718f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:14 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Volume volume-08497f88-a0d7-443f-b496-34f27f592022 (08497f88-a0d7-443f-b496-34f27f592022): created successfully
Nov 07 02:45:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e94ac42-7f84-4ce1-8f6e-62e1b637718f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Flow 'volume_create_manager' (f94f3274-3372-4f2b-aad2-9c599b5c68d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:14 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-caf45aac-6f36-4742-8c25-3dd14602de8b tempest-VolumesCloneNegativeTest-303069153 None] Created volume successfully.
Nov 07 02:45:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8a4005e0-4953-40e2-8613-34bff9290efc tempest-VolumesCloneNegativeTest-303069153 None] Acquiring lock "cinder-08497f88-a0d7-443f-b496-34f27f592022-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:45:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8a4005e0-4953-40e2-8613-34bff9290efc tempest-VolumesCloneNegativeTest-303069153 None] Lock "cinder-08497f88-a0d7-443f-b496-34f27f592022-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:45:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8a4005e0-4953-40e2-8613-34bff9290efc tempest-VolumesCloneNegativeTest-303069153 None] Acquiring lock "cinder-quobyte-08497f88-a0d7-443f-b496-34f27f592022" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:45:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8a4005e0-4953-40e2-8613-34bff9290efc tempest-VolumesCloneNegativeTest-303069153 None] Lock "cinder-quobyte-08497f88-a0d7-443f-b496-34f27f592022" acquired by "delete_volume" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:45:15 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f04512-b429-444d-a659-692ed012cbd7]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:45:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8a4005e0-4953-40e2-8613-34bff9290efc tempest-VolumesCloneNegativeTest-303069153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08497f88-a0d7-443f-b496-34f27f592022 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:15 devstack sudo[103340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08497f88-a0d7-443f-b496-34f27f592022
Nov 07 02:45:15 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:16 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8a4005e0-4953-40e2-8613-34bff9290efc tempest-VolumesCloneNegativeTest-303069153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08497f88-a0d7-443f-b496-34f27f592022" returned: 0 in 0.405s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8a4005e0-4953-40e2-8613-34bff9290efc tempest-VolumesCloneNegativeTest-303069153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08497f88-a0d7-443f-b496-34f27f592022 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:16 devstack sudo[103345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08497f88-a0d7-443f-b496-34f27f592022
Nov 07 02:45:16 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:16 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8a4005e0-4953-40e2-8613-34bff9290efc tempest-VolumesCloneNegativeTest-303069153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-08497f88-a0d7-443f-b496-34f27f592022" returned: 0 in 0.280s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8a4005e0-4953-40e2-8613-34bff9290efc tempest-VolumesCloneNegativeTest-303069153 None] Lock "cinder-quobyte-08497f88-a0d7-443f-b496-34f27f592022" released by "delete_volume" :: held 0.729s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:45:16 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=102,cinder:INSERT=29,cinder:UPDATE=130,cinder:DELETE=14 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:45:16 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=100,cinder:INSERT=29,cinder:UPDATE=123,cinder:DELETE=6 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:45:16 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-8a4005e0-4953-40e2-8613-34bff9290efc tempest-VolumesCloneNegativeTest-303069153 None] Created reservations ['25334dbe-6d65-4b6e-b502-e5e9a0607d18', '6c7ac84a-ccf4-44ee-86f1-434b202898ac', '94d2a880-964a-4916-89b8-42d5afbaf870', '6c237e61-e927-4a35-9f5f-9606fa7b1821'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:45:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8a4005e0-4953-40e2-8613-34bff9290efc tempest-VolumesCloneNegativeTest-303069153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8a4005e0-4953-40e2-8613-34bff9290efc tempest-VolumesCloneNegativeTest-303069153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8a4005e0-4953-40e2-8613-34bff9290efc tempest-VolumesCloneNegativeTest-303069153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8a4005e0-4953-40e2-8613-34bff9290efc tempest-VolumesCloneNegativeTest-303069153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8a4005e0-4953-40e2-8613-34bff9290efc tempest-VolumesCloneNegativeTest-303069153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8a4005e0-4953-40e2-8613-34bff9290efc tempest-VolumesCloneNegativeTest-303069153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:16 devstack sudo[103348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:45:16 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:16 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8a4005e0-4953-40e2-8613-34bff9290efc tempest-VolumesCloneNegativeTest-303069153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.295s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:16 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-8a4005e0-4953-40e2-8613-34bff9290efc tempest-VolumesCloneNegativeTest-303069153 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:45:16 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-8a4005e0-4953-40e2-8613-34bff9290efc tempest-VolumesCloneNegativeTest-303069153 None] Deleted volume successfully.
Nov 07 02:45:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8a4005e0-4953-40e2-8613-34bff9290efc tempest-VolumesCloneNegativeTest-303069153 None] Lock "cinder-08497f88-a0d7-443f-b496-34f27f592022-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:45:20 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:45:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Flow 'volume_create_manager' (d6d358d3-1f02-407a-89f3-9fb3595f955d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e8bdb21-bbb5-47f2-bf96-f06e752271d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e8bdb21-bbb5-47f2-bf96-f06e752271d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1644322034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fcf89ac-e9af-4f6c-bfb2-59726b3e1082,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='667b46dcbb6840caabcca633b4c225a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:21Z,use_quota=True,user_id='60700e451ad143a493d83b83f7a285d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a5a569-3919-4b45-a446-88ca4141d2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a5a569-3919-4b45-a446-88ca4141d2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80fbcae2-ba1d-4f01-8bfa-f6c63cef28a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80fbcae2-ba1d-4f01-8bfa-f6c63cef28a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fcf89ac-e9af-4f6c-bfb2-59726b3e1082', 'volume_name': 'volume-8fcf89ac-e9af-4f6c-bfb2-59726b3e1082', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1577fd02-bfac-4ae7-a139-c92a07dc5ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1577fd02-bfac-4ae7-a139-c92a07dc5ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d8a45d-f646-490d-9738-6502d73d25fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:20 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Volume 8fcf89ac-e9af-4f6c-bfb2-59726b3e1082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fcf89ac-e9af-4f6c-bfb2-59726b3e1082', 'volume_size': 1}
Nov 07 02:45:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1644322034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fcf89ac-e9af-4f6c-bfb2-59726b3e1082,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='667b46dcbb6840caabcca633b4c225a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:21Z,use_quota=True,user_id='60700e451ad143a493d83b83f7a285d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:45:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Creating volume 8fcf89ac-e9af-4f6c-bfb2-59726b3e1082 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:45:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:45:20 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:45:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8fcf89ac-e9af-4f6c-bfb2-59726b3e1082 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:20 devstack sudo[103352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8fcf89ac-e9af-4f6c-bfb2-59726b3e1082 1073741824
Nov 07 02:45:20 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:21 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8fcf89ac-e9af-4f6c-bfb2-59726b3e1082 1073741824" returned: 0 in 0.502s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8fcf89ac-e9af-4f6c-bfb2-59726b3e1082 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:21 devstack sudo[103358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8fcf89ac-e9af-4f6c-bfb2-59726b3e1082
Nov 07 02:45:21 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:21 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8fcf89ac-e9af-4f6c-bfb2-59726b3e1082" returned: 0 in 0.248s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:21 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:45:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:21 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d8a45d-f646-490d-9738-6502d73d25fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fcf89ac-e9af-4f6c-bfb2-59726b3e1082', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:21 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ef1ac7-055b-468f-b9f0-b40708383c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:21 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Volume volume-8fcf89ac-e9af-4f6c-bfb2-59726b3e1082 (8fcf89ac-e9af-4f6c-bfb2-59726b3e1082): created successfully
Nov 07 02:45:21 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ef1ac7-055b-468f-b9f0-b40708383c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:21 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Flow 'volume_create_manager' (d6d358d3-1f02-407a-89f3-9fb3595f955d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:21 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-91ea96a6-acea-4891-8497-2ce2ab2c3c6a tempest-VolumesGetTest-725066039 None] Created volume successfully.
Nov 07 02:45:23 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:45:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Flow 'volume_create_manager' (68634ea6-cd3a-418a-a148-2b3918d04095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eda60f1-e34f-4fe2-bb65-8f78d188ddb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eda60f1-e34f-4fe2-bb65-8f78d188ddb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-639496974',display_name='tempest-VolumesGetTest-Volume-824767712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529da7e8-793a-4796-ae36-4af431858ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='667b46dcbb6840caabcca633b4c225a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:24Z,use_quota=True,user_id='60700e451ad143a493d83b83f7a285d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657f750c-f96e-42af-8c6e-21fbe53bad1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657f750c-f96e-42af-8c6e-21fbe53bad1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875355e3-07b2-4f3b-b507-2ce4dfd4c3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875355e3-07b2-4f3b-b507-2ce4dfd4c3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '529da7e8-793a-4796-ae36-4af431858ab5', 'volume_name': 'volume-529da7e8-793a-4796-ae36-4af431858ab5', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a367e8d7-60d5-4904-9523-281b3ba42e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a367e8d7-60d5-4904-9523-281b3ba42e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4a5a0f-38dd-4a64-bb79-8f4ac127e478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:23 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Volume 529da7e8-793a-4796-ae36-4af431858ab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-529da7e8-793a-4796-ae36-4af431858ab5', 'volume_size': 1}
Nov 07 02:45:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-639496974',display_name='tempest-VolumesGetTest-Volume-824767712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529da7e8-793a-4796-ae36-4af431858ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='667b46dcbb6840caabcca633b4c225a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:24Z,use_quota=True,user_id='60700e451ad143a493d83b83f7a285d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:45:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Creating volume 529da7e8-793a-4796-ae36-4af431858ab5 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:45:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:45:23 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:45:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-529da7e8-793a-4796-ae36-4af431858ab5 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:24 devstack sudo[103361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-529da7e8-793a-4796-ae36-4af431858ab5 1073741824
Nov 07 02:45:24 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:24 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-529da7e8-793a-4796-ae36-4af431858ab5 1073741824" returned: 0 in 0.462s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-529da7e8-793a-4796-ae36-4af431858ab5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:24 devstack sudo[103367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-529da7e8-793a-4796-ae36-4af431858ab5
Nov 07 02:45:24 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:24 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-529da7e8-793a-4796-ae36-4af431858ab5" returned: 0 in 0.274s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:45:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4a5a0f-38dd-4a64-bb79-8f4ac127e478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-529da7e8-793a-4796-ae36-4af431858ab5', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd5a34f-83a5-4b20-9ff0-e2d5bda26dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:24 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Volume volume-529da7e8-793a-4796-ae36-4af431858ab5 (529da7e8-793a-4796-ae36-4af431858ab5): created successfully
Nov 07 02:45:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd5a34f-83a5-4b20-9ff0-e2d5bda26dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Flow 'volume_create_manager' (68634ea6-cd3a-418a-a148-2b3918d04095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:24 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-a50643aa-6182-44d4-a4cb-0da56d28f729 tempest-VolumesGetTest-725066039 None] Created volume successfully.
Nov 07 02:45:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2fd341d7-bbea-4efd-8ab3-5fbf12f94f91 tempest-VolumesGetTest-725066039 None] Acquiring lock "cinder-529da7e8-793a-4796-ae36-4af431858ab5-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:45:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2fd341d7-bbea-4efd-8ab3-5fbf12f94f91 tempest-VolumesGetTest-725066039 None] Lock "cinder-529da7e8-793a-4796-ae36-4af431858ab5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:45:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2fd341d7-bbea-4efd-8ab3-5fbf12f94f91 tempest-VolumesGetTest-725066039 None] Acquiring lock "cinder-quobyte-529da7e8-793a-4796-ae36-4af431858ab5" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:45:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2fd341d7-bbea-4efd-8ab3-5fbf12f94f91 tempest-VolumesGetTest-725066039 None] Lock "cinder-quobyte-529da7e8-793a-4796-ae36-4af431858ab5" acquired by "delete_volume" :: waited 0.024s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:45:26 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[d578a964-d7fb-4abe-b4c7-5f77eab63aa9]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:45:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2fd341d7-bbea-4efd-8ab3-5fbf12f94f91 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-529da7e8-793a-4796-ae36-4af431858ab5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:26 devstack sudo[103372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-529da7e8-793a-4796-ae36-4af431858ab5
Nov 07 02:45:26 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:26 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2fd341d7-bbea-4efd-8ab3-5fbf12f94f91 tempest-VolumesGetTest-725066039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-529da7e8-793a-4796-ae36-4af431858ab5" returned: 0 in 0.377s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2fd341d7-bbea-4efd-8ab3-5fbf12f94f91 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-529da7e8-793a-4796-ae36-4af431858ab5 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:26 devstack sudo[103378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-529da7e8-793a-4796-ae36-4af431858ab5
Nov 07 02:45:26 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:26 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2fd341d7-bbea-4efd-8ab3-5fbf12f94f91 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-529da7e8-793a-4796-ae36-4af431858ab5" returned: 0 in 0.279s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2fd341d7-bbea-4efd-8ab3-5fbf12f94f91 tempest-VolumesGetTest-725066039 None] Lock "cinder-quobyte-529da7e8-793a-4796-ae36-4af431858ab5" released by "delete_volume" :: held 0.705s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:45:27 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-2fd341d7-bbea-4efd-8ab3-5fbf12f94f91 tempest-VolumesGetTest-725066039 None] Created reservations ['b7bb1f4f-cec6-4efd-b609-6f3c3721f368', '33be13ec-4201-4fd7-80bb-d9565327313f', '59bdc3b9-0cea-496b-844b-1785ba8a6d5d', 'f031eafb-b1ae-475f-ba56-0ca8b4a6584f'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:45:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2fd341d7-bbea-4efd-8ab3-5fbf12f94f91 tempest-VolumesGetTest-725066039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2fd341d7-bbea-4efd-8ab3-5fbf12f94f91 tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2fd341d7-bbea-4efd-8ab3-5fbf12f94f91 tempest-VolumesGetTest-725066039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2fd341d7-bbea-4efd-8ab3-5fbf12f94f91 tempest-VolumesGetTest-725066039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2fd341d7-bbea-4efd-8ab3-5fbf12f94f91 tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2fd341d7-bbea-4efd-8ab3-5fbf12f94f91 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:27 devstack sudo[103381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:45:27 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:27 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2fd341d7-bbea-4efd-8ab3-5fbf12f94f91 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.266s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:27 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-2fd341d7-bbea-4efd-8ab3-5fbf12f94f91 tempest-VolumesGetTest-725066039 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:45:27 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-2fd341d7-bbea-4efd-8ab3-5fbf12f94f91 tempest-VolumesGetTest-725066039 None] Deleted volume successfully.
Nov 07 02:45:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2fd341d7-bbea-4efd-8ab3-5fbf12f94f91 tempest-VolumesGetTest-725066039 None] Lock "cinder-529da7e8-793a-4796-ae36-4af431858ab5-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:45:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1a465522-8b50-4def-844d-5510e62bd7f8 tempest-VolumesGetTest-725066039 None] Acquiring lock "cinder-8fcf89ac-e9af-4f6c-bfb2-59726b3e1082-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:45:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1a465522-8b50-4def-844d-5510e62bd7f8 tempest-VolumesGetTest-725066039 None] Lock "cinder-8fcf89ac-e9af-4f6c-bfb2-59726b3e1082-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:45:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1a465522-8b50-4def-844d-5510e62bd7f8 tempest-VolumesGetTest-725066039 None] Acquiring lock "cinder-quobyte-8fcf89ac-e9af-4f6c-bfb2-59726b3e1082" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:45:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1a465522-8b50-4def-844d-5510e62bd7f8 tempest-VolumesGetTest-725066039 None] Lock "cinder-quobyte-8fcf89ac-e9af-4f6c-bfb2-59726b3e1082" acquired by "delete_volume" :: waited 0.014s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:45:27 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[066f3a43-c285-4e28-a386-5ccbd88e3548]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:45:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1a465522-8b50-4def-844d-5510e62bd7f8 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8fcf89ac-e9af-4f6c-bfb2-59726b3e1082 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:27 devstack sudo[103384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8fcf89ac-e9af-4f6c-bfb2-59726b3e1082
Nov 07 02:45:27 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:27 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1a465522-8b50-4def-844d-5510e62bd7f8 tempest-VolumesGetTest-725066039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8fcf89ac-e9af-4f6c-bfb2-59726b3e1082" returned: 0 in 0.409s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1a465522-8b50-4def-844d-5510e62bd7f8 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8fcf89ac-e9af-4f6c-bfb2-59726b3e1082 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:27 devstack sudo[103390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8fcf89ac-e9af-4f6c-bfb2-59726b3e1082
Nov 07 02:45:27 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:28 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1a465522-8b50-4def-844d-5510e62bd7f8 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-8fcf89ac-e9af-4f6c-bfb2-59726b3e1082" returned: 0 in 0.252s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1a465522-8b50-4def-844d-5510e62bd7f8 tempest-VolumesGetTest-725066039 None] Lock "cinder-quobyte-8fcf89ac-e9af-4f6c-bfb2-59726b3e1082" released by "delete_volume" :: held 0.706s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:45:28 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-1a465522-8b50-4def-844d-5510e62bd7f8 tempest-VolumesGetTest-725066039 None] Created reservations ['ce0d5fee-6329-4fe2-9620-5ab13337125d', 'd70c2b6d-555f-4393-a893-6479813b637b', '2984f07a-b25f-4732-8537-812b545a8d2b', 'a58c8584-7d3d-4318-abf8-0ea7b912a72c'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:45:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1a465522-8b50-4def-844d-5510e62bd7f8 tempest-VolumesGetTest-725066039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1a465522-8b50-4def-844d-5510e62bd7f8 tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-1a465522-8b50-4def-844d-5510e62bd7f8 tempest-VolumesGetTest-725066039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-1a465522-8b50-4def-844d-5510e62bd7f8 tempest-VolumesGetTest-725066039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1a465522-8b50-4def-844d-5510e62bd7f8 tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1a465522-8b50-4def-844d-5510e62bd7f8 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:28 devstack sudo[103393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:45:28 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:28 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1a465522-8b50-4def-844d-5510e62bd7f8 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.283s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:28 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-1a465522-8b50-4def-844d-5510e62bd7f8 tempest-VolumesGetTest-725066039 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:45:28 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-1a465522-8b50-4def-844d-5510e62bd7f8 tempest-VolumesGetTest-725066039 None] Deleted volume successfully.
Nov 07 02:45:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1a465522-8b50-4def-844d-5510e62bd7f8 tempest-VolumesGetTest-725066039 None] Lock "cinder-8fcf89ac-e9af-4f6c-bfb2-59726b3e1082-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Flow 'volume_create_manager' (2a18fd45-480e-47ad-a532-25a01b221cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4e9282-5ff0-4cf4-9953-c0a3931a4e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4e9282-5ff0-4cf4-9953-c0a3931a4e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-663593774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300e12fe-f763-422e-a5fe-c6d90c4e8aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='667b46dcbb6840caabcca633b4c225a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:29Z,use_quota=True,user_id='60700e451ad143a493d83b83f7a285d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa9293d-0f30-4f35-a55d-ba4a8711ef9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa9293d-0f30-4f35-a55d-ba4a8711ef9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ede7d9a-80a2-445d-8699-20eca3929eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ede7d9a-80a2-445d-8699-20eca3929eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '300e12fe-f763-422e-a5fe-c6d90c4e8aea', 'volume_name': 'volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e54fb38-c17b-4029-891b-fccd12178ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e54fb38-c17b-4029-891b-fccd12178ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f11495-cce5-4b02-901d-d04d052725d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:29 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Volume 300e12fe-f763-422e-a5fe-c6d90c4e8aea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea', 'volume_size': 1}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-663593774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300e12fe-f763-422e-a5fe-c6d90c4e8aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='667b46dcbb6840caabcca633b4c225a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:29Z,use_quota=True,user_id='60700e451ad143a493d83b83f7a285d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Creating volume 300e12fe-f763-422e-a5fe-c6d90c4e8aea {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:45:29 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:29 devstack sudo[103396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea 1073741824
Nov 07 02:45:29 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:29 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea 1073741824" returned: 0 in 0.428s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:29 devstack sudo[103402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea
Nov 07 02:45:29 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:29 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea" returned: 0 in 0.250s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f11495-cce5-4b02-901d-d04d052725d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c71acfb-c5fc-491c-92c4-5d6801371fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:29 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Volume volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea (300e12fe-f763-422e-a5fe-c6d90c4e8aea): created successfully
Nov 07 02:45:29 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c71acfb-c5fc-491c-92c4-5d6801371fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Flow 'volume_create_manager' (2a18fd45-480e-47ad-a532-25a01b221cbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:30 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-6d01253f-d401-47e2-a8bb-92f94b35d3f2 tempest-VolumesGetTest-725066039 None] Created volume successfully.
Nov 07 02:45:30 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:45:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Flow 'volume_create_manager' (5b5d9b7f-7196-4bc7-84cb-986d61440f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe1e5aa-170b-4e35-bca4-3d5ddee96cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe1e5aa-170b-4e35-bca4-3d5ddee96cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1056990235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='667b46dcbb6840caabcca633b4c225a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=300e12fe-f763-422e-a5fe-c6d90c4e8aea,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:31Z,use_quota=True,user_id='60700e451ad143a493d83b83f7a285d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185fe706-91d6-42f2-a5fc-97d5e5654b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185fe706-91d6-42f2-a5fc-97d5e5654b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbda30b-8bac-4a1a-84db-f8e30398a5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbda30b-8bac-4a1a-84db-f8e30398a5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f', 'volume_name': 'volume-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f', 'volume_size': 1, 'source_volid': '300e12fe-f763-422e-a5fe-c6d90c4e8aea', 'source_volstatus': 'available'}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd37eaf-a7f8-4abb-8818-d5ca78384135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd37eaf-a7f8-4abb-8818-d5ca78384135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c014b5c6-b05a-4a09-a886-2f913d33371f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:30 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Volume ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f', 'volume_size': 1, 'source_volid': '300e12fe-f763-422e-a5fe-c6d90c4e8aea', 'source_volstatus': 'available'}
Nov 07 02:45:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:30 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Cloning volume 300e12fe-f763-422e-a5fe-c6d90c4e8aea to volume ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f
Nov 07 02:45:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Creating offline snapshot 8cf003cd-eab5-4165-8c50-a52248e62ffa of volume 300e12fe-f763-422e-a5fe-c6d90c4e8aea {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:45:30 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e06709-b85f-4fd2-ab48-f71e75cf177a]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:45:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:30 devstack sudo[103405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea
Nov 07 02:45:30 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:31 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea" returned: 0 in 0.403s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.8cf003cd-eab5-4165-8c50-a52248e62ffa 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:31 devstack sudo[103410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.8cf003cd-eab5-4165-8c50-a52248e62ffa 1G
Nov 07 02:45:31 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:31 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.8cf003cd-eab5-4165-8c50-a52248e62ffa 1G" returned: 0 in 0.437s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.8cf003cd-eab5-4165-8c50-a52248e62ffa {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:31 devstack sudo[103416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.8cf003cd-eab5-4165-8c50-a52248e62ffa
Nov 07 02:45:31 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:31 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.8cf003cd-eab5-4165-8c50-a52248e62ffa" returned: 0 in 0.304s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:32 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.8cf003cd-eab5-4165-8c50-a52248e62ffa is being set with open permissions: ugo+rw
Nov 07 02:45:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.8cf003cd-eab5-4165-8c50-a52248e62ffa {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:32 devstack sudo[103421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.8cf003cd-eab5-4165-8c50-a52248e62ffa
Nov 07 02:45:32 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:32 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.8cf003cd-eab5-4165-8c50-a52248e62ffa" returned: 0 in 0.273s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:32 devstack sudo[103427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.info
Nov 07 02:45:32 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:32 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.info" returned: 0 in 0.274s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:32 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.info is being set with open permissions: ugo+rw
Nov 07 02:45:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:32 devstack sudo[103430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.info
Nov 07 02:45:32 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:32 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.info" returned: 0 in 0.255s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Acquiring lock "cinder-quobyte-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f" by "_copy_volume_from_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:45:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Lock "cinder-quobyte-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:45:32 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] snapshot: 8cf003cd-eab5-4165-8c50-a52248e62ffa, volume: ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f,  {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:45:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:32 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:32 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:32 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee274f9-f357-4a1b-8a9c-b550ae17b0c7]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:45:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.8cf003cd-eab5-4165-8c50-a52248e62ffa {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:33 devstack sudo[103433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.8cf003cd-eab5-4165-8c50-a52248e62ffa
Nov 07 02:45:33 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:33 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.8cf003cd-eab5-4165-8c50-a52248e62ffa" returned: 0 in 0.392s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:45:33 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d92de3d-29d1-48a0-9f8e-1612fd096271]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:45:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:33 devstack sudo[103438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea
Nov 07 02:45:33 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:33 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea" returned: 0 in 0.411s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:45:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Creating direct copy from snapshot {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:45:33 devstack cinder-volume[87054]: DEBUG cinder.utils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Path /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f not found in is_blk_device check {{(pid=87054) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:45:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:33 devstack sudo[103443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f
Nov 07 02:45:33 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:43 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f" returned: 0 in 9.410s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Image conversion details: src /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea, size 1024.00 MB, duration 9.41 sec, destination /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:45:43 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Converted 1024.00 MB image at 108.81 MB/s
Nov 07 02:45:43 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f is being set with open permissions: ugo+rw
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:43 devstack sudo[103563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f
Nov 07 02:45:43 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:43 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f" returned: 0 in 0.269s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Lock "cinder-quobyte-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f" released by "_copy_volume_from_snapshot" :: held 10.566s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Acquiring lock "cinder-quobyte-8cf003cd-eab5-4165-8c50-a52248e62ffa" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Lock "cinder-quobyte-8cf003cd-eab5-4165-8c50-a52248e62ffa" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Deleting offline snapshot 8cf003cd-eab5-4165-8c50-a52248e62ffa of volume 300e12fe-f763-422e-a5fe-c6d90c4e8aea {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] snapshot_file for this snap is: volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.8cf003cd-eab5-4165-8c50-a52248e62ffa {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd237f29-0ab9-47df-bfa6-43fcb19fbdae]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.8cf003cd-eab5-4165-8c50-a52248e62ffa {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:43 devstack sudo[103566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.8cf003cd-eab5-4165-8c50-a52248e62ffa
Nov 07 02:45:43 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Flow 'volume_create_manager' (36cad1d3-7d14-40fc-9c95-42e7b07b88b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c55d236-0fdd-4385-bb56-934c5cd81920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c55d236-0fdd-4385-bb56-934c5cd81920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1749651807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0076846-9b6b-4c94-92ea-f11e9e230020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccb740ee00a42d6ac757d7000b347a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:44Z,use_quota=True,user_id='feed82c865f948f988147af09736eb2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b158af5-bc4c-45ca-a192-9dd5255ec1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b158af5-bc4c-45ca-a192-9dd5255ec1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112ea3f4-266d-4f5e-91d8-b773c70e0b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112ea3f4-266d-4f5e-91d8-b773c70e0b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0076846-9b6b-4c94-92ea-f11e9e230020', 'volume_name': 'volume-d0076846-9b6b-4c94-92ea-f11e9e230020', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a40c2f4-7205-4bc2-a987-7224f376383a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a40c2f4-7205-4bc2-a987-7224f376383a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59b925a-1379-4e18-ba63-bd7345776c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:43 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Volume d0076846-9b6b-4c94-92ea-f11e9e230020: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0076846-9b6b-4c94-92ea-f11e9e230020', 'volume_size': 1}
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:43 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.8cf003cd-eab5-4165-8c50-a52248e62ffa" returned: 0 in 0.364s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfb8eff-ce0c-4739-88fe-739ce0781e87]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:45:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:44 devstack sudo[103571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea
Nov 07 02:45:44 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:44 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea" returned: 0 in 0.543s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.8cf003cd-eab5-4165-8c50-a52248e62ffa {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:44 devstack sudo[103576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.8cf003cd-eab5-4165-8c50-a52248e62ffa
Nov 07 02:45:44 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:44 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.8cf003cd-eab5-4165-8c50-a52248e62ffa" returned: 0 in 0.350s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.8cf003cd-eab5-4165-8c50-a52248e62ffa {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:44 devstack sudo[103581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.8cf003cd-eab5-4165-8c50-a52248e62ffa
Nov 07 02:45:44 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:45 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea.8cf003cd-eab5-4165-8c50-a52248e62ffa" returned: 0 in 0.258s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Lock "cinder-quobyte-8cf003cd-eab5-4165-8c50-a52248e62ffa" released by "_delete_snapshot" :: held 1.644s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.365s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.374s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1749651807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0076846-9b6b-4c94-92ea-f11e9e230020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccb740ee00a42d6ac757d7000b347a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:44Z,use_quota=True,user_id='feed82c865f948f988147af09736eb2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Creating volume d0076846-9b6b-4c94-92ea-f11e9e230020 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:45:45 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0076846-9b6b-4c94-92ea-f11e9e230020 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c014b5c6-b05a-4a09-a886-2f913d33371f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f', 'volume_size': 1, 'source_volid': '300e12fe-f763-422e-a5fe-c6d90c4e8aea', 'source_volstatus': 'available'}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:45 devstack sudo[103584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0076846-9b6b-4c94-92ea-f11e9e230020 1073741824
Nov 07 02:45:45 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890b8ce7-b1cc-4482-9a89-39c36884e9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:45 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Volume volume-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f (ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f): created successfully
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890b8ce7-b1cc-4482-9a89-39c36884e9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Flow 'volume_create_manager' (5b5d9b7f-7196-4bc7-84cb-986d61440f70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:45 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-0a5b74cd-85a5-4bea-9950-d1f423042204 tempest-VolumesGetTest-725066039 None] Created volume successfully.
Nov 07 02:45:45 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0076846-9b6b-4c94-92ea-f11e9e230020 1073741824" returned: 0 in 0.487s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0076846-9b6b-4c94-92ea-f11e9e230020 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:45 devstack sudo[103590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0076846-9b6b-4c94-92ea-f11e9e230020
Nov 07 02:45:45 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:45 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0076846-9b6b-4c94-92ea-f11e9e230020" returned: 0 in 0.264s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59b925a-1379-4e18-ba63-bd7345776c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0076846-9b6b-4c94-92ea-f11e9e230020', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671343a6-f881-4736-a144-ed5ec97f7070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:46 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Volume volume-d0076846-9b6b-4c94-92ea-f11e9e230020 (d0076846-9b6b-4c94-92ea-f11e9e230020): created successfully
Nov 07 02:45:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671343a6-f881-4736-a144-ed5ec97f7070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Flow 'volume_create_manager' (36cad1d3-7d14-40fc-9c95-42e7b07b88b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:46 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f338e59f-7daa-4d76-bd16-911b6da70d30 tempest-TestMinimumBasicScenario-135742014 None] Created volume successfully.
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Flow 'volume_create_manager' (42026bee-15a4-4bb4-9cb0-09168e2a8c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91eb28bf-2853-48c2-98ee-240ae54fd8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91eb28bf-2853-48c2-98ee-240ae54fd8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1191771299',display_name='tempest-VolumesGetTest-Volume-42119857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b31335-e18a-4d43-89d4-6a85248c0afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='667b46dcbb6840caabcca633b4c225a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:47Z,use_quota=True,user_id='60700e451ad143a493d83b83f7a285d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97cc8415-d47b-4395-81e1-aea95807e514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97cc8415-d47b-4395-81e1-aea95807e514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d757b44-5b4b-4fc3-aade-244074eb7bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d757b44-5b4b-4fc3-aade-244074eb7bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32b31335-e18a-4d43-89d4-6a85248c0afc', 'volume_name': 'volume-32b31335-e18a-4d43-89d4-6a85248c0afc', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77637855-2203-4eeb-93da-80488f35feb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77637855-2203-4eeb-93da-80488f35feb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5afe3025-0e11-4cbb-a939-545af4607ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:47 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Volume 32b31335-e18a-4d43-89d4-6a85248c0afc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32b31335-e18a-4d43-89d4-6a85248c0afc', 'volume_size': 1}
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1191771299',display_name='tempest-VolumesGetTest-Volume-42119857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b31335-e18a-4d43-89d4-6a85248c0afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='667b46dcbb6840caabcca633b4c225a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:47Z,use_quota=True,user_id='60700e451ad143a493d83b83f7a285d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Creating volume 32b31335-e18a-4d43-89d4-6a85248c0afc {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:45:47 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-32b31335-e18a-4d43-89d4-6a85248c0afc 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:47 devstack sudo[103596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-32b31335-e18a-4d43-89d4-6a85248c0afc 1073741824
Nov 07 02:45:47 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:47 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-32b31335-e18a-4d43-89d4-6a85248c0afc 1073741824" returned: 0 in 0.566s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-32b31335-e18a-4d43-89d4-6a85248c0afc {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:47 devstack sudo[103612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-32b31335-e18a-4d43-89d4-6a85248c0afc
Nov 07 02:45:47 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-f7a50fb3-9a67-4489-b350-8ed0b654608d req-f6456851-830f-4306-99b9-028d0428ea9d tempest-TestMinimumBasicScenario-135742014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:48 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-32b31335-e18a-4d43-89d4-6a85248c0afc" returned: 0 in 0.303s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:45:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-f7a50fb3-9a67-4489-b350-8ed0b654608d req-f6456851-830f-4306-99b9-028d0428ea9d tempest-TestMinimumBasicScenario-135742014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.220s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:48 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5afe3025-0e11-4cbb-a939-545af4607ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32b31335-e18a-4d43-89d4-6a85248c0afc', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:48 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b0b2d7-8f21-4427-b813-9753d82a0b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-f7a50fb3-9a67-4489-b350-8ed0b654608d req-f6456851-830f-4306-99b9-028d0428ea9d tempest-TestMinimumBasicScenario-135742014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:48 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Volume volume-32b31335-e18a-4d43-89d4-6a85248c0afc (32b31335-e18a-4d43-89d4-6a85248c0afc): created successfully
Nov 07 02:45:48 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b0b2d7-8f21-4427-b813-9753d82a0b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:48 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Flow 'volume_create_manager' (42026bee-15a4-4bb4-9cb0-09168e2a8c1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:48 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-706f759e-6944-4fbb-a9ea-238697cd663e tempest-VolumesGetTest-725066039 None] Created volume successfully.
Nov 07 02:45:48 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-f7a50fb3-9a67-4489-b350-8ed0b654608d req-f6456851-830f-4306-99b9-028d0428ea9d tempest-TestMinimumBasicScenario-135742014 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c', 'name': 'volume-d0076846-9b6b-4c94-92ea-f11e9e230020', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a7670af-5fa0-4f47-a7d7-9d10d6be7cf5', 'enforce_multipath': True} {{(pid=87054) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:45:48 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-f7a50fb3-9a67-4489-b350-8ed0b654608d req-f6456851-830f-4306-99b9-028d0428ea9d tempest-TestMinimumBasicScenario-135742014 None] attachment_update completed successfully.
Nov 07 02:45:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-59dc38d5-53ab-4c51-b524-6869b1f77fb0 tempest-VolumesGetTest-725066039 None] Acquiring lock "cinder-32b31335-e18a-4d43-89d4-6a85248c0afc-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:45:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-59dc38d5-53ab-4c51-b524-6869b1f77fb0 tempest-VolumesGetTest-725066039 None] Lock "cinder-32b31335-e18a-4d43-89d4-6a85248c0afc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:45:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-59dc38d5-53ab-4c51-b524-6869b1f77fb0 tempest-VolumesGetTest-725066039 None] Acquiring lock "cinder-quobyte-32b31335-e18a-4d43-89d4-6a85248c0afc" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:45:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-59dc38d5-53ab-4c51-b524-6869b1f77fb0 tempest-VolumesGetTest-725066039 None] Lock "cinder-quobyte-32b31335-e18a-4d43-89d4-6a85248c0afc" acquired by "delete_volume" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:45:49 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfba27ce-a17d-4ede-9c07-523e1d66957d]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:45:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-59dc38d5-53ab-4c51-b524-6869b1f77fb0 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-32b31335-e18a-4d43-89d4-6a85248c0afc {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:49 devstack sudo[104040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-32b31335-e18a-4d43-89d4-6a85248c0afc
Nov 07 02:45:49 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:49 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-59dc38d5-53ab-4c51-b524-6869b1f77fb0 tempest-VolumesGetTest-725066039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-32b31335-e18a-4d43-89d4-6a85248c0afc" returned: 0 in 0.381s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-59dc38d5-53ab-4c51-b524-6869b1f77fb0 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-32b31335-e18a-4d43-89d4-6a85248c0afc {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:49 devstack sudo[104046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-32b31335-e18a-4d43-89d4-6a85248c0afc
Nov 07 02:45:49 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:50 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-59dc38d5-53ab-4c51-b524-6869b1f77fb0 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-32b31335-e18a-4d43-89d4-6a85248c0afc" returned: 0 in 0.278s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-59dc38d5-53ab-4c51-b524-6869b1f77fb0 tempest-VolumesGetTest-725066039 None] Lock "cinder-quobyte-32b31335-e18a-4d43-89d4-6a85248c0afc" released by "delete_volume" :: held 0.712s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:45:50 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-59dc38d5-53ab-4c51-b524-6869b1f77fb0 tempest-VolumesGetTest-725066039 None] Created reservations ['1a031c8b-ecaf-4521-9c4f-55be8df15e39', 'b03b4154-00a8-45b8-8dbb-8b117653e66f', 'a162d54d-c63f-4844-b982-422c81cf6f98', '2cd3680a-8dcc-4a66-9a38-6c5b54b1c44d'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:45:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-59dc38d5-53ab-4c51-b524-6869b1f77fb0 tempest-VolumesGetTest-725066039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-59dc38d5-53ab-4c51-b524-6869b1f77fb0 tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:50 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-59dc38d5-53ab-4c51-b524-6869b1f77fb0 tempest-VolumesGetTest-725066039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:50 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-59dc38d5-53ab-4c51-b524-6869b1f77fb0 tempest-VolumesGetTest-725066039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-59dc38d5-53ab-4c51-b524-6869b1f77fb0 tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-59dc38d5-53ab-4c51-b524-6869b1f77fb0 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:50 devstack sudo[104049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:45:50 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:50 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-59dc38d5-53ab-4c51-b524-6869b1f77fb0 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.284s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:50 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-59dc38d5-53ab-4c51-b524-6869b1f77fb0 tempest-VolumesGetTest-725066039 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:45:50 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-59dc38d5-53ab-4c51-b524-6869b1f77fb0 tempest-VolumesGetTest-725066039 None] Deleted volume successfully.
Nov 07 02:45:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-59dc38d5-53ab-4c51-b524-6869b1f77fb0 tempest-VolumesGetTest-725066039 None] Lock "cinder-32b31335-e18a-4d43-89d4-6a85248c0afc-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:45:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-293273e3-d9ab-4420-b71b-20850d87c815 tempest-VolumesGetTest-725066039 None] Acquiring lock "cinder-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:45:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-293273e3-d9ab-4420-b71b-20850d87c815 tempest-VolumesGetTest-725066039 None] Lock "cinder-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:45:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-293273e3-d9ab-4420-b71b-20850d87c815 tempest-VolumesGetTest-725066039 None] Acquiring lock "cinder-quobyte-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:45:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-293273e3-d9ab-4420-b71b-20850d87c815 tempest-VolumesGetTest-725066039 None] Lock "cinder-quobyte-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f" acquired by "delete_volume" :: waited 0.019s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:45:50 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9617d18-75ed-4a01-a5e7-8e92bee3aa7e]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:45:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-293273e3-d9ab-4420-b71b-20850d87c815 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:50 devstack sudo[104052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f
Nov 07 02:45:50 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:51 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-293273e3-d9ab-4420-b71b-20850d87c815 tempest-VolumesGetTest-725066039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f" returned: 0 in 0.406s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-293273e3-d9ab-4420-b71b-20850d87c815 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:51 devstack sudo[104057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f
Nov 07 02:45:51 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:51 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-293273e3-d9ab-4420-b71b-20850d87c815 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f" returned: 0 in 0.273s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-293273e3-d9ab-4420-b71b-20850d87c815 tempest-VolumesGetTest-725066039 None] Lock "cinder-quobyte-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f" released by "delete_volume" :: held 0.726s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:45:51 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-293273e3-d9ab-4420-b71b-20850d87c815 tempest-VolumesGetTest-725066039 None] Created reservations ['094a9140-3bc5-446b-ba80-defc9023d097', 'a62eadd5-f685-4ecd-9a88-e9a18077a14e', 'b7939de3-6a9e-4006-b2e5-f336343509e5', 'b97464fa-d0c8-4e0c-a988-882299f55451'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:45:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-293273e3-d9ab-4420-b71b-20850d87c815 tempest-VolumesGetTest-725066039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-293273e3-d9ab-4420-b71b-20850d87c815 tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:51 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-293273e3-d9ab-4420-b71b-20850d87c815 tempest-VolumesGetTest-725066039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:51 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-293273e3-d9ab-4420-b71b-20850d87c815 tempest-VolumesGetTest-725066039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-293273e3-d9ab-4420-b71b-20850d87c815 tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-293273e3-d9ab-4420-b71b-20850d87c815 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:51 devstack sudo[104060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:45:51 devstack sudo[104060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:51 devstack sudo[104060]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-293273e3-d9ab-4420-b71b-20850d87c815 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.299s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:52 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-293273e3-d9ab-4420-b71b-20850d87c815 tempest-VolumesGetTest-725066039 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:45:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-54c155b3-26dd-42ae-afc0-aede1f0d9072 tempest-VolumesGetTest-725066039 None] Acquiring lock "cinder-300e12fe-f763-422e-a5fe-c6d90c4e8aea-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:45:52 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-293273e3-d9ab-4420-b71b-20850d87c815 tempest-VolumesGetTest-725066039 None] Deleted volume successfully.
Nov 07 02:45:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-54c155b3-26dd-42ae-afc0-aede1f0d9072 tempest-VolumesGetTest-725066039 None] Lock "cinder-300e12fe-f763-422e-a5fe-c6d90c4e8aea-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:45:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-293273e3-d9ab-4420-b71b-20850d87c815 tempest-VolumesGetTest-725066039 None] Lock "cinder-ab1d5c35-8563-4e3d-94b8-f9cd6d460c3f-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:45:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-54c155b3-26dd-42ae-afc0-aede1f0d9072 tempest-VolumesGetTest-725066039 None] Acquiring lock "cinder-quobyte-300e12fe-f763-422e-a5fe-c6d90c4e8aea" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:45:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-54c155b3-26dd-42ae-afc0-aede1f0d9072 tempest-VolumesGetTest-725066039 None] Lock "cinder-quobyte-300e12fe-f763-422e-a5fe-c6d90c4e8aea" acquired by "delete_volume" :: waited 0.029s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:45:52 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a982de-a79b-4bd0-abdc-236e708198a2]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:45:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-54c155b3-26dd-42ae-afc0-aede1f0d9072 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:52 devstack sudo[104063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea
Nov 07 02:45:52 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:52 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-54c155b3-26dd-42ae-afc0-aede1f0d9072 tempest-VolumesGetTest-725066039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea" returned: 0 in 0.417s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-54c155b3-26dd-42ae-afc0-aede1f0d9072 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:52 devstack sudo[104070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea
Nov 07 02:45:52 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:53 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-54c155b3-26dd-42ae-afc0-aede1f0d9072 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-300e12fe-f763-422e-a5fe-c6d90c4e8aea" returned: 0 in 0.409s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-54c155b3-26dd-42ae-afc0-aede1f0d9072 tempest-VolumesGetTest-725066039 None] Lock "cinder-quobyte-300e12fe-f763-422e-a5fe-c6d90c4e8aea" released by "delete_volume" :: held 0.959s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:45:53 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-54c155b3-26dd-42ae-afc0-aede1f0d9072 tempest-VolumesGetTest-725066039 None] Created reservations ['65f1eaa7-ad87-4217-9d94-7237c6903abc', '774cb548-1782-46c2-b28c-b37ef68034af', '994e053b-0f81-4f1b-b131-41cc9ca96a3f', '9e549a1a-05c6-406e-9bd6-813a3a1e6647'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:45:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-54c155b3-26dd-42ae-afc0-aede1f0d9072 tempest-VolumesGetTest-725066039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-54c155b3-26dd-42ae-afc0-aede1f0d9072 tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-54c155b3-26dd-42ae-afc0-aede1f0d9072 tempest-VolumesGetTest-725066039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-54c155b3-26dd-42ae-afc0-aede1f0d9072 tempest-VolumesGetTest-725066039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-54c155b3-26dd-42ae-afc0-aede1f0d9072 tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-54c155b3-26dd-42ae-afc0-aede1f0d9072 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:53 devstack sudo[104101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:45:53 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:53 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-54c155b3-26dd-42ae-afc0-aede1f0d9072 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.354s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:53 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-54c155b3-26dd-42ae-afc0-aede1f0d9072 tempest-VolumesGetTest-725066039 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:45:53 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-54c155b3-26dd-42ae-afc0-aede1f0d9072 tempest-VolumesGetTest-725066039 None] Deleted volume successfully.
Nov 07 02:45:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-54c155b3-26dd-42ae-afc0-aede1f0d9072 tempest-VolumesGetTest-725066039 None] Lock "cinder-300e12fe-f763-422e-a5fe-c6d90c4e8aea-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:45:55 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:45:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Flow 'volume_create_manager' (05b6baa4-58c5-41fe-9fec-df9f6e4371e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:45:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6ea429-ac9b-46dc-91de-2d68432116ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6ea429-ac9b-46dc-91de-2d68432116ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-813945446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f19766-eb1b-45e4-9308-7c986a874125,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='667b46dcbb6840caabcca633b4c225a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:55Z,use_quota=True,user_id='60700e451ad143a493d83b83f7a285d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ef7f77-1339-46a1-bed8-32acc822f995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ef7f77-1339-46a1-bed8-32acc822f995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (442266f0-c73a-485e-b673-aa7640acb223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:55 devstack cinder-volume[87054]: DEBUG cinder.image.glance [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Creating Keystone auth plugin from conf {{(pid=87054) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 07 02:45:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (442266f0-c73a-485e-b673-aa7640acb223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '86f19766-eb1b-45e4-9308-7c986a874125', 'volume_name': 'volume-86f19766-eb1b-45e4-9308-7c986a874125', 'volume_size': 1, 'image_id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567ec8d3497e4e06904abb9c1c036004', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 25, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72170a12c1a0>}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c7155b-45ec-48a5-8f69-1d6d9d26ab3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c7155b-45ec-48a5-8f69-1d6d9d26ab3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:45:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c12d4ebc-78cd-417d-bc3e-82f2eb634250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:45:55 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Volume 86f19766-eb1b-45e4-9308-7c986a874125: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-86f19766-eb1b-45e4-9308-7c986a874125', 'volume_size': 1, 'image_id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567ec8d3497e4e06904abb9c1c036004', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 25, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72170a12c1a0>}
Nov 07 02:45:55 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Trying to clone 86f19766-eb1b-45e4-9308-7c986a874125 from image b7a104a5-0b13-4f47-bea7-fab65f1346d5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}]). {{(pid=87054) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 07 02:45:55 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_1xq0jmeodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 07 02:45:55 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Image download 20.69 MB at 20.69 MB/s
Nov 07 02:45:55 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[5574c4ed-8e24-4000-b100-8246cd9fb5ee]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:45:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_1xq0jmeodevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:56 devstack sudo[104108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_1xq0jmeodevstack@QuobyteHD
Nov 07 02:45:56 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:56 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_1xq0jmeodevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:56 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Temporary image b7a104a5-0b13-4f47-bea7-fab65f1346d5 is fetched for user 60700e451ad143a493d83b83f7a285d9. {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 07 02:45:56 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[8614145d-2a91-4d35-8b10-35e1d43a9fa3]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:45:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_1xq0jmeodevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:56 devstack sudo[104113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_1xq0jmeodevstack@QuobyteHD
Nov 07 02:45:56 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:56 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_1xq0jmeodevstack@QuobyteHD" returned: 0 in 0.318s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:56 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-813945446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f19766-eb1b-45e4-9308-7c986a874125,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='667b46dcbb6840caabcca633b4c225a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:45:55Z,use_quota=True,user_id='60700e451ad143a493d83b83f7a285d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:45:56 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Creating volume 86f19766-eb1b-45e4-9308-7c986a874125 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:45:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:56 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:56 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:56 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:45:56 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:45:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-86f19766-eb1b-45e4-9308-7c986a874125 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:56 devstack sudo[104118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-86f19766-eb1b-45e4-9308-7c986a874125 1073741824
Nov 07 02:45:56 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:57 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-86f19766-eb1b-45e4-9308-7c986a874125 1073741824" returned: 0 in 0.423s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-86f19766-eb1b-45e4-9308-7c986a874125 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:57 devstack sudo[104124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-86f19766-eb1b-45e4-9308-7c986a874125
Nov 07 02:45:57 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:57 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-86f19766-eb1b-45e4-9308-7c986a874125" returned: 0 in 0.236s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:57 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:45:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:57 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Attempting download of b7a104a5-0b13-4f47-bea7-fab65f1346d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}])) to volume 86f19766-eb1b-45e4-9308-7c986a874125. {{(pid=87054) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 07 02:45:57 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ad8605-3d66-4c50-a8f8-6101352ad6df]: (4, 'raw') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:45:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_t0n39rj1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:57 devstack sudo[104128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_t0n39rj1
Nov 07 02:45:57 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:57 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_t0n39rj1" returned: 0 in 0.313s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_t0n39rj1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:57 devstack sudo[104133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_t0n39rj1
Nov 07 02:45:57 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:58 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_t0n39rj1" returned: 1 in 0.327s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7a104a5-0b13-4f47-bea7-fab65f1346d5_t0n39rj1' failed. Not Retrying. {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:45:58 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[328c297d-d3cf-4564-b523-dcf6ffc20113]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:45:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_1xq0jmeodevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:58 devstack sudo[104138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_1xq0jmeodevstack@QuobyteHD
Nov 07 02:45:58 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:58 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_1xq0jmeodevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:58 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] b7a104a5-0b13-4f47-bea7-fab65f1346d5 was qcow2, converting to qcow2 {{(pid=87054) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 07 02:45:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_1xq0jmeodevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-86f19766-eb1b-45e4-9308-7c986a874125 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:58 devstack sudo[104143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_1xq0jmeodevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-86f19766-eb1b-45e4-9308-7c986a874125
Nov 07 02:45:58 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:45:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:45:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:45:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:45:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:45:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:45:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:45:59 devstack sudo[104154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:45:59 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:45:59 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root
Nov 07 02:45:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.269s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:45:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:45:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:45:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 28 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:45:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>, <Thread(fd_logger, started daemon 125443282798592)>, <Thread(privsep_reader, started daemon 125443284556288)>, <Thread(tpool_thread_0, started daemon 125443276445376)>, <Thread(tpool_thread_1, started daemon 125443268036288)>, <Thread(tpool_thread_2, started daemon 125443259627200)>, <Thread(tpool_thread_3, started daemon 125443251218112)>, <Thread(tpool_thread_4, started daemon 125443242809024)>, <Thread(tpool_thread_5, started daemon 125443234399936)>, <Thread(tpool_thread_6, started daemon 125443225990848)>, <Thread(tpool_thread_7, started daemon 125443217581760)>, <Thread(tpool_thread_8, started daemon 125443209172672)>, <Thread(tpool_thread_9, started daemon 125443200763584)>, <Thread(tpool_thread_10, started daemon 125443192354496)>, <Thread(tpool_thread_11, started daemon 125443183945408)>, <Thread(tpool_thread_12, started daemon 125443175536320)>, <Thread(tpool_thread_13, started daemon 125443167127232)>, <Thread(tpool_thread_14, started daemon 125443158718144)>, <Thread(tpool_thread_15, started daemon 125443150309056)>, <Thread(tpool_thread_16, started daemon 125443141899968)>, <Thread(tpool_thread_17, started daemon 125443133490880)>, <Thread(tpool_thread_18, started daemon 125443125081792)>, <Thread(tpool_thread_19, started daemon 125443116672704)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:46:00 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_1xq0jmeodevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-86f19766-eb1b-45e4-9308-7c986a874125" returned: 0 in 1.732s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:00 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b7a104a5-0b13-4f47-bea7-fab65f1346d5_1xq0jmeodevstack@QuobyteHD, size 112.00 MB, duration 1.73 sec, destination /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-86f19766-eb1b-45e4-9308-7c986a874125 {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:46:00 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Converted 112.00 MB image at 64.63 MB/s
Nov 07 02:46:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-86f19766-eb1b-45e4-9308-7c986a874125 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:00 devstack sudo[104158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-86f19766-eb1b-45e4-9308-7c986a874125 1G
Nov 07 02:46:00 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:00 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-86f19766-eb1b-45e4-9308-7c986a874125 1G" returned: 0 in 0.365s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:00 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Downloaded image b7a104a5-0b13-4f47-bea7-fab65f1346d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}])) to volume 86f19766-eb1b-45e4-9308-7c986a874125 successfully. {{(pid=87054) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 07 02:46:00 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Temporary image b7a104a5-0b13-4f47-bea7-fab65f1346d5 for user 60700e451ad143a493d83b83f7a285d9 is deleted. {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 07 02:46:00 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Marking volume 86f19766-eb1b-45e4-9308-7c986a874125 as bootable. {{(pid=87054) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 07 02:46:00 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Copying metadata from image b7a104a5-0b13-4f47-bea7-fab65f1346d5 to 86f19766-eb1b-45e4-9308-7c986a874125. {{(pid=87054) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 07 02:46:00 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Creating volume glance metadata for volume 86f19766-eb1b-45e4-9308-7c986a874125 backed by image b7a104a5-0b13-4f47-bea7-fab65f1346d5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87054) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 07 02:46:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c12d4ebc-78cd-417d-bc3e-82f2eb634250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86f19766-eb1b-45e4-9308-7c986a874125', 'volume_size': 1, 'image_id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567ec8d3497e4e06904abb9c1c036004', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7a104a5-0b13-4f47-bea7-fab65f1346d5', 'created_at': datetime.datetime(2026, 11, 7, 1, 25, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 25, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7a104a5-0b13-4f47-bea7-fab65f1346d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72170a12c1a0>}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bc36dcd-cf61-4bf7-a6c0-ee35c1587740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:00 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Volume volume-86f19766-eb1b-45e4-9308-7c986a874125 (86f19766-eb1b-45e4-9308-7c986a874125): created successfully
Nov 07 02:46:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bc36dcd-cf61-4bf7-a6c0-ee35c1587740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Flow 'volume_create_manager' (05b6baa4-58c5-41fe-9fec-df9f6e4371e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:46:00 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-422b40d3-6275-47b7-9ba7-8fe5075d939d tempest-VolumesGetTest-725066039 None] Created volume successfully.
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Flow 'volume_create_manager' (c0498730-bdb2-4943-a4fd-46980cfae2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e87f8c77-008a-48af-ba6d-c70ca931b2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e87f8c77-008a-48af-ba6d-c70ca931b2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:46:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1483755076',display_name='tempest-VolumesGetTest-Volume-1196239155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4904f1-e4c2-469c-aa20-50c56aff00f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='667b46dcbb6840caabcca633b4c225a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:46:02Z,use_quota=True,user_id='60700e451ad143a493d83b83f7a285d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9eaa6b-b200-4615-96df-ba3a248c2e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9eaa6b-b200-4615-96df-ba3a248c2e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54257d24-accd-4541-8efe-4f48e5631645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54257d24-accd-4541-8efe-4f48e5631645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa4904f1-e4c2-469c-aa20-50c56aff00f7', 'volume_name': 'volume-aa4904f1-e4c2-469c-aa20-50c56aff00f7', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28595a37-fb34-4af2-b11f-d9e185e4cd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28595a37-fb34-4af2-b11f-d9e185e4cd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94b40dd-cebb-4b63-8055-f333052c64e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:02 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Volume aa4904f1-e4c2-469c-aa20-50c56aff00f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa4904f1-e4c2-469c-aa20-50c56aff00f7', 'volume_size': 1}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:46:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1483755076',display_name='tempest-VolumesGetTest-Volume-1196239155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4904f1-e4c2-469c-aa20-50c56aff00f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='667b46dcbb6840caabcca633b4c225a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:46:02Z,use_quota=True,user_id='60700e451ad143a493d83b83f7a285d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Creating volume aa4904f1-e4c2-469c-aa20-50c56aff00f7 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:46:02 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa4904f1-e4c2-469c-aa20-50c56aff00f7 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:02 devstack sudo[104165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa4904f1-e4c2-469c-aa20-50c56aff00f7 1073741824
Nov 07 02:46:02 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:02 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa4904f1-e4c2-469c-aa20-50c56aff00f7 1073741824" returned: 0 in 0.408s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa4904f1-e4c2-469c-aa20-50c56aff00f7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:02 devstack sudo[104171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa4904f1-e4c2-469c-aa20-50c56aff00f7
Nov 07 02:46:02 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:02 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa4904f1-e4c2-469c-aa20-50c56aff00f7" returned: 0 in 0.253s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94b40dd-cebb-4b63-8055-f333052c64e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa4904f1-e4c2-469c-aa20-50c56aff00f7', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81f2001b-4af9-40a1-9be0-3bf23038c50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:02 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Volume volume-aa4904f1-e4c2-469c-aa20-50c56aff00f7 (aa4904f1-e4c2-469c-aa20-50c56aff00f7): created successfully
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81f2001b-4af9-40a1-9be0-3bf23038c50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:02 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Flow 'volume_create_manager' (c0498730-bdb2-4943-a4fd-46980cfae2f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:46:02 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-45d2ab8a-b6b0-4a99-a85d-4c8b387b3265 tempest-VolumesGetTest-725066039 None] Created volume successfully.
Nov 07 02:46:03 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c17e0031-48d3-4676-9e3a-826b6376d46d tempest-VolumesGetTest-725066039 None] Acquiring lock "cinder-aa4904f1-e4c2-469c-aa20-50c56aff00f7-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:03 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c17e0031-48d3-4676-9e3a-826b6376d46d tempest-VolumesGetTest-725066039 None] Lock "cinder-aa4904f1-e4c2-469c-aa20-50c56aff00f7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:03 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c17e0031-48d3-4676-9e3a-826b6376d46d tempest-VolumesGetTest-725066039 None] Acquiring lock "cinder-quobyte-aa4904f1-e4c2-469c-aa20-50c56aff00f7" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:03 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c17e0031-48d3-4676-9e3a-826b6376d46d tempest-VolumesGetTest-725066039 None] Lock "cinder-quobyte-aa4904f1-e4c2-469c-aa20-50c56aff00f7" acquired by "delete_volume" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:03 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ff5a73-1555-416b-825d-133ebbb2ce53]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c17e0031-48d3-4676-9e3a-826b6376d46d tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa4904f1-e4c2-469c-aa20-50c56aff00f7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:03 devstack sudo[104212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa4904f1-e4c2-469c-aa20-50c56aff00f7
Nov 07 02:46:03 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:03 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c17e0031-48d3-4676-9e3a-826b6376d46d tempest-VolumesGetTest-725066039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa4904f1-e4c2-469c-aa20-50c56aff00f7" returned: 0 in 0.367s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c17e0031-48d3-4676-9e3a-826b6376d46d tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa4904f1-e4c2-469c-aa20-50c56aff00f7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:03 devstack sudo[104217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa4904f1-e4c2-469c-aa20-50c56aff00f7
Nov 07 02:46:03 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:04 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c17e0031-48d3-4676-9e3a-826b6376d46d tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-aa4904f1-e4c2-469c-aa20-50c56aff00f7" returned: 0 in 0.278s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c17e0031-48d3-4676-9e3a-826b6376d46d tempest-VolumesGetTest-725066039 None] Lock "cinder-quobyte-aa4904f1-e4c2-469c-aa20-50c56aff00f7" released by "delete_volume" :: held 0.704s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:04 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-c17e0031-48d3-4676-9e3a-826b6376d46d tempest-VolumesGetTest-725066039 None] Created reservations ['2b2bbf41-c7b4-4a8c-b458-6dc7308bfe78', '61941556-4070-4b5d-8f1a-a3d5c87f4fda', '5d243654-05ad-4f61-8cc3-e35e6524102c', 'e14c45c3-8f89-4d76-bf83-ed63ae8a1a00'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c17e0031-48d3-4676-9e3a-826b6376d46d tempest-VolumesGetTest-725066039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c17e0031-48d3-4676-9e3a-826b6376d46d tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c17e0031-48d3-4676-9e3a-826b6376d46d tempest-VolumesGetTest-725066039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c17e0031-48d3-4676-9e3a-826b6376d46d tempest-VolumesGetTest-725066039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c17e0031-48d3-4676-9e3a-826b6376d46d tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c17e0031-48d3-4676-9e3a-826b6376d46d tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:04 devstack sudo[104220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:46:04 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:04 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c17e0031-48d3-4676-9e3a-826b6376d46d tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.245s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:04 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-c17e0031-48d3-4676-9e3a-826b6376d46d tempest-VolumesGetTest-725066039 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:46:04 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c17e0031-48d3-4676-9e3a-826b6376d46d tempest-VolumesGetTest-725066039 None] Deleted volume successfully.
Nov 07 02:46:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c17e0031-48d3-4676-9e3a-826b6376d46d tempest-VolumesGetTest-725066039 None] Lock "cinder-aa4904f1-e4c2-469c-aa20-50c56aff00f7-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1639595a-9381-437f-a913-b87ca3f6a5c1 tempest-VolumesGetTest-725066039 None] Acquiring lock "cinder-86f19766-eb1b-45e4-9308-7c986a874125-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1639595a-9381-437f-a913-b87ca3f6a5c1 tempest-VolumesGetTest-725066039 None] Lock "cinder-86f19766-eb1b-45e4-9308-7c986a874125-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1639595a-9381-437f-a913-b87ca3f6a5c1 tempest-VolumesGetTest-725066039 None] Acquiring lock "cinder-quobyte-86f19766-eb1b-45e4-9308-7c986a874125" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:04 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1639595a-9381-437f-a913-b87ca3f6a5c1 tempest-VolumesGetTest-725066039 None] Lock "cinder-quobyte-86f19766-eb1b-45e4-9308-7c986a874125" acquired by "delete_volume" :: waited 0.018s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:04 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9697e7-9894-4635-84a3-a968e5b8ebd3]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1639595a-9381-437f-a913-b87ca3f6a5c1 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-86f19766-eb1b-45e4-9308-7c986a874125 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:04 devstack sudo[104223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-86f19766-eb1b-45e4-9308-7c986a874125
Nov 07 02:46:04 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:05 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1639595a-9381-437f-a913-b87ca3f6a5c1 tempest-VolumesGetTest-725066039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-86f19766-eb1b-45e4-9308-7c986a874125" returned: 0 in 0.353s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1639595a-9381-437f-a913-b87ca3f6a5c1 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-86f19766-eb1b-45e4-9308-7c986a874125 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:05 devstack sudo[104228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-86f19766-eb1b-45e4-9308-7c986a874125
Nov 07 02:46:05 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:05 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1639595a-9381-437f-a913-b87ca3f6a5c1 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-86f19766-eb1b-45e4-9308-7c986a874125" returned: 0 in 0.242s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1639595a-9381-437f-a913-b87ca3f6a5c1 tempest-VolumesGetTest-725066039 None] Lock "cinder-quobyte-86f19766-eb1b-45e4-9308-7c986a874125" released by "delete_volume" :: held 0.645s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:05 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-1639595a-9381-437f-a913-b87ca3f6a5c1 tempest-VolumesGetTest-725066039 None] Created reservations ['bd3bf7a8-0c82-4421-8fd9-da540ea56360', 'a102a04b-5748-4a49-9359-4cabb56b73f9', '216bc0e2-06f7-46fc-b5d5-5fa7dddcfba1', 'a66c7fba-8aa6-4be5-813e-e77b24ec54d8'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1639595a-9381-437f-a913-b87ca3f6a5c1 tempest-VolumesGetTest-725066039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1639595a-9381-437f-a913-b87ca3f6a5c1 tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-1639595a-9381-437f-a913-b87ca3f6a5c1 tempest-VolumesGetTest-725066039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-1639595a-9381-437f-a913-b87ca3f6a5c1 tempest-VolumesGetTest-725066039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1639595a-9381-437f-a913-b87ca3f6a5c1 tempest-VolumesGetTest-725066039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1639595a-9381-437f-a913-b87ca3f6a5c1 tempest-VolumesGetTest-725066039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:05 devstack sudo[104231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:46:05 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:05 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1639595a-9381-437f-a913-b87ca3f6a5c1 tempest-VolumesGetTest-725066039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.243s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:05 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-1639595a-9381-437f-a913-b87ca3f6a5c1 tempest-VolumesGetTest-725066039 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:46:05 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-1639595a-9381-437f-a913-b87ca3f6a5c1 tempest-VolumesGetTest-725066039 None] Deleted volume successfully.
Nov 07 02:46:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1639595a-9381-437f-a913-b87ca3f6a5c1 tempest-VolumesGetTest-725066039 None] Lock "cinder-86f19766-eb1b-45e4-9308-7c986a874125-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:15 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:UPDATE=89,cinder:SELECT=73,cinder:DELETE=10,cinder:INSERT=24 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:46:15 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=70,cinder:INSERT=31,cinder:UPDATE=96,cinder:DELETE=6 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:46:32 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-6e9c8e7d-d9f6-4fd0-8e05-9ab08efccf75 req-3b76bb6f-0b17-416e-93e3-5b3c8856dc1b tempest-TestMinimumBasicScenario-135742014 None] Terminate volume connection completed successfully.
Nov 07 02:46:32 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-6e9c8e7d-d9f6-4fd0-8e05-9ab08efccf75 req-3b76bb6f-0b17-416e-93e3-5b3c8856dc1b tempest-TestMinimumBasicScenario-135742014 None] Deleting attachment 3a7670af-5fa0-4f47-a7d7-9d10d6be7cf5. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:46:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9b3fc88d-4e53-48f5-8c6b-24a1e5541748 tempest-TestMinimumBasicScenario-135742014 None] Acquiring lock "cinder-d0076846-9b6b-4c94-92ea-f11e9e230020-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9b3fc88d-4e53-48f5-8c6b-24a1e5541748 tempest-TestMinimumBasicScenario-135742014 None] Lock "cinder-d0076846-9b6b-4c94-92ea-f11e9e230020-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9b3fc88d-4e53-48f5-8c6b-24a1e5541748 tempest-TestMinimumBasicScenario-135742014 None] Acquiring lock "cinder-quobyte-d0076846-9b6b-4c94-92ea-f11e9e230020" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9b3fc88d-4e53-48f5-8c6b-24a1e5541748 tempest-TestMinimumBasicScenario-135742014 None] Lock "cinder-quobyte-d0076846-9b6b-4c94-92ea-f11e9e230020" acquired by "delete_volume" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:33 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[4365e14d-9763-42bd-a303-1e28b35ad00f]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9b3fc88d-4e53-48f5-8c6b-24a1e5541748 tempest-TestMinimumBasicScenario-135742014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0076846-9b6b-4c94-92ea-f11e9e230020 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:33 devstack sudo[104310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0076846-9b6b-4c94-92ea-f11e9e230020
Nov 07 02:46:33 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:33 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9b3fc88d-4e53-48f5-8c6b-24a1e5541748 tempest-TestMinimumBasicScenario-135742014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0076846-9b6b-4c94-92ea-f11e9e230020" returned: 0 in 0.408s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9b3fc88d-4e53-48f5-8c6b-24a1e5541748 tempest-TestMinimumBasicScenario-135742014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0076846-9b6b-4c94-92ea-f11e9e230020 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:33 devstack sudo[104315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0076846-9b6b-4c94-92ea-f11e9e230020
Nov 07 02:46:33 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:34 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9b3fc88d-4e53-48f5-8c6b-24a1e5541748 tempest-TestMinimumBasicScenario-135742014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d0076846-9b6b-4c94-92ea-f11e9e230020" returned: 0 in 0.316s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9b3fc88d-4e53-48f5-8c6b-24a1e5541748 tempest-TestMinimumBasicScenario-135742014 None] Lock "cinder-quobyte-d0076846-9b6b-4c94-92ea-f11e9e230020" released by "delete_volume" :: held 0.777s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:34 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-9b3fc88d-4e53-48f5-8c6b-24a1e5541748 tempest-TestMinimumBasicScenario-135742014 None] Created reservations ['0f352cd8-932e-4199-8c3a-68b162309a79', 'b6183558-bdbc-49fb-ae47-3f0d8a4ce813', 'd7840518-0b6f-459b-a7ba-635add79b753', '7cb999af-adf5-476f-8c7e-ee70f1d4aa69'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9b3fc88d-4e53-48f5-8c6b-24a1e5541748 tempest-TestMinimumBasicScenario-135742014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9b3fc88d-4e53-48f5-8c6b-24a1e5541748 tempest-TestMinimumBasicScenario-135742014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9b3fc88d-4e53-48f5-8c6b-24a1e5541748 tempest-TestMinimumBasicScenario-135742014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9b3fc88d-4e53-48f5-8c6b-24a1e5541748 tempest-TestMinimumBasicScenario-135742014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9b3fc88d-4e53-48f5-8c6b-24a1e5541748 tempest-TestMinimumBasicScenario-135742014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9b3fc88d-4e53-48f5-8c6b-24a1e5541748 tempest-TestMinimumBasicScenario-135742014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:34 devstack sudo[104318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:46:34 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:34 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9b3fc88d-4e53-48f5-8c6b-24a1e5541748 tempest-TestMinimumBasicScenario-135742014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.319s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:34 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-9b3fc88d-4e53-48f5-8c6b-24a1e5541748 tempest-TestMinimumBasicScenario-135742014 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:46:34 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-9b3fc88d-4e53-48f5-8c6b-24a1e5541748 tempest-TestMinimumBasicScenario-135742014 None] Deleted volume successfully.
Nov 07 02:46:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9b3fc88d-4e53-48f5-8c6b-24a1e5541748 tempest-TestMinimumBasicScenario-135742014 None] Lock "cinder-d0076846-9b6b-4c94-92ea-f11e9e230020-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:35 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:46:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Flow 'volume_create_manager' (2ab3fbe3-3a18-4d55-9335-7e3b2ccc5311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:46:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b64ddea-7ba3-47e2-8b5a-1f705820b993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b64ddea-7ba3-47e2-8b5a-1f705820b993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1177394642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fcd09a8-b7d1-4988-83de-f3e5f9782139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2727106ac29481cb2fd631389660b2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:46:36Z,use_quota=True,user_id='8dcb490ee95c4853be6b6616f3b9c2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2e2d54-3794-4173-a086-8f4dc5190ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2e2d54-3794-4173-a086-8f4dc5190ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1706994f-8d92-4757-b77a-f40314275851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1706994f-8d92-4757-b77a-f40314275851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fcd09a8-b7d1-4988-83de-f3e5f9782139', 'volume_name': 'volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3323e6d-2972-4754-86c9-ff3a572da63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3323e6d-2972-4754-86c9-ff3a572da63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69e051d-73b6-4bf3-ae6a-90105c56d5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:35 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Volume 5fcd09a8-b7d1-4988-83de-f3e5f9782139: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139', 'volume_size': 1}
Nov 07 02:46:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1177394642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fcd09a8-b7d1-4988-83de-f3e5f9782139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2727106ac29481cb2fd631389660b2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:46:36Z,use_quota=True,user_id='8dcb490ee95c4853be6b6616f3b9c2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:46:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Creating volume 5fcd09a8-b7d1-4988-83de-f3e5f9782139 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:46:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:46:35 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:46:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:35 devstack sudo[104341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139 1073741824
Nov 07 02:46:35 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:36 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139 1073741824" returned: 0 in 0.538s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:36 devstack sudo[104349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139
Nov 07 02:46:36 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:36 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139" returned: 0 in 0.262s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:46:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69e051d-73b6-4bf3-ae6a-90105c56d5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e7f4cf-ea94-4870-8443-c9758858d2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:36 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Volume volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139 (5fcd09a8-b7d1-4988-83de-f3e5f9782139): created successfully
Nov 07 02:46:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e7f4cf-ea94-4870-8443-c9758858d2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Flow 'volume_create_manager' (2ab3fbe3-3a18-4d55-9335-7e3b2ccc5311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:46:36 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-eaec9461-5acf-4796-8265-b6ed7f091c81 tempest-SnapshotDependencyTests-1476829251 None] Created volume successfully.
Nov 07 02:46:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-4488f5b3-b31f-4cca-b7dc-fe51f2dcf4f4 tempest-SnapshotDependencyTests-1476829251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-4488f5b3-b31f-4cca-b7dc-fe51f2dcf4f4 tempest-SnapshotDependencyTests-1476829251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:37 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-4488f5b3-b31f-4cca-b7dc-fe51f2dcf4f4 tempest-SnapshotDependencyTests-1476829251 None] Creating offline snapshot 9590fd97-ece5-4ee0-aa31-6811334aa6bf of volume 5fcd09a8-b7d1-4988-83de-f3e5f9782139 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:46:37 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8beed8-f1cf-4bb4-8f36-fabab4792a3f]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4488f5b3-b31f-4cca-b7dc-fe51f2dcf4f4 tempest-SnapshotDependencyTests-1476829251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:38 devstack sudo[104352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139
Nov 07 02:46:38 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:38 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4488f5b3-b31f-4cca-b7dc-fe51f2dcf4f4 tempest-SnapshotDependencyTests-1476829251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139" returned: 0 in 0.404s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4488f5b3-b31f-4cca-b7dc-fe51f2dcf4f4 tempest-SnapshotDependencyTests-1476829251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.9590fd97-ece5-4ee0-aa31-6811334aa6bf 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:38 devstack sudo[104358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.9590fd97-ece5-4ee0-aa31-6811334aa6bf 1G
Nov 07 02:46:38 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:38 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4488f5b3-b31f-4cca-b7dc-fe51f2dcf4f4 tempest-SnapshotDependencyTests-1476829251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.9590fd97-ece5-4ee0-aa31-6811334aa6bf 1G" returned: 0 in 0.420s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4488f5b3-b31f-4cca-b7dc-fe51f2dcf4f4 tempest-SnapshotDependencyTests-1476829251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.9590fd97-ece5-4ee0-aa31-6811334aa6bf {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:38 devstack sudo[104365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.9590fd97-ece5-4ee0-aa31-6811334aa6bf
Nov 07 02:46:38 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:39 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4488f5b3-b31f-4cca-b7dc-fe51f2dcf4f4 tempest-SnapshotDependencyTests-1476829251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.9590fd97-ece5-4ee0-aa31-6811334aa6bf" returned: 0 in 0.305s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:39 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-4488f5b3-b31f-4cca-b7dc-fe51f2dcf4f4 tempest-SnapshotDependencyTests-1476829251 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.9590fd97-ece5-4ee0-aa31-6811334aa6bf is being set with open permissions: ugo+rw
Nov 07 02:46:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4488f5b3-b31f-4cca-b7dc-fe51f2dcf4f4 tempest-SnapshotDependencyTests-1476829251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.9590fd97-ece5-4ee0-aa31-6811334aa6bf {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:39 devstack sudo[104370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.9590fd97-ece5-4ee0-aa31-6811334aa6bf
Nov 07 02:46:39 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:39 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4488f5b3-b31f-4cca-b7dc-fe51f2dcf4f4 tempest-SnapshotDependencyTests-1476829251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.9590fd97-ece5-4ee0-aa31-6811334aa6bf" returned: 0 in 0.247s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4488f5b3-b31f-4cca-b7dc-fe51f2dcf4f4 tempest-SnapshotDependencyTests-1476829251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:39 devstack sudo[104374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.info
Nov 07 02:46:39 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:39 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4488f5b3-b31f-4cca-b7dc-fe51f2dcf4f4 tempest-SnapshotDependencyTests-1476829251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.info" returned: 0 in 0.248s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:39 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-4488f5b3-b31f-4cca-b7dc-fe51f2dcf4f4 tempest-SnapshotDependencyTests-1476829251 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.info is being set with open permissions: ugo+rw
Nov 07 02:46:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4488f5b3-b31f-4cca-b7dc-fe51f2dcf4f4 tempest-SnapshotDependencyTests-1476829251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:39 devstack sudo[104377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.info
Nov 07 02:46:39 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:39 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4488f5b3-b31f-4cca-b7dc-fe51f2dcf4f4 tempest-SnapshotDependencyTests-1476829251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.info" returned: 0 in 0.274s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-4488f5b3-b31f-4cca-b7dc-fe51f2dcf4f4 tempest-SnapshotDependencyTests-1476829251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.994s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:39 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-4488f5b3-b31f-4cca-b7dc-fe51f2dcf4f4 tempest-SnapshotDependencyTests-1476829251 None] Create snapshot completed successfully
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Flow 'volume_create_manager' (44d8c738-fcbe-486c-92e5-006e8aaa7b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c75854b-6d35-4a13-9706-0372f341b1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c75854b-6d35-4a13-9706-0372f341b1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49d2e87-58d4-4c9b-8183-8119174ca88d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2727106ac29481cb2fd631389660b2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9590fd97-ece5-4ee0-aa31-6811334aa6bf,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:46:41Z,use_quota=True,user_id='8dcb490ee95c4853be6b6616f3b9c2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8745f79-cbdb-4235-8e1e-aa48ac80b1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8745f79-cbdb-4235-8e1e-aa48ac80b1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f41272-7a4b-4260-b0e7-bf86ed730407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f41272-7a4b-4260-b0e7-bf86ed730407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd49d2e87-58d4-4c9b-8183-8119174ca88d', 'volume_name': 'volume-d49d2e87-58d4-4c9b-8183-8119174ca88d', 'volume_size': 1, 'snapshot_id': '9590fd97-ece5-4ee0-aa31-6811334aa6bf'}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a08784-bedc-41d2-bb9b-c47915b71a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a08784-bedc-41d2-bb9b-c47915b71a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8dccfd-ffc7-4859-9f76-2d7a045d93f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:40 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Volume d49d2e87-58d4-4c9b-8183-8119174ca88d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d49d2e87-58d4-4c9b-8183-8119174ca88d', 'volume_size': 1, 'snapshot_id': '9590fd97-ece5-4ee0-aa31-6811334aa6bf'}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Acquiring lock "cinder-quobyte-9590fd97-ece5-4ee0-aa31-6811334aa6bf-d49d2e87-58d4-4c9b-8183-8119174ca88d" by "_create_volume_from_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Lock "cinder-quobyte-9590fd97-ece5-4ee0-aa31-6811334aa6bf-d49d2e87-58d4-4c9b-8183-8119174ca88d" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Creating volume d49d2e87-58d4-4c9b-8183-8119174ca88d from snapshot 9590fd97-ece5-4ee0-aa31-6811334aa6bf {{(pid=87054) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Acquiring lock "cinder-quobyte-d49d2e87-58d4-4c9b-8183-8119174ca88d" by "_copy_volume_from_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Lock "cinder-quobyte-d49d2e87-58d4-4c9b-8183-8119174ca88d" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] snapshot: 9590fd97-ece5-4ee0-aa31-6811334aa6bf, volume: d49d2e87-58d4-4c9b-8183-8119174ca88d,  {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[4512bcd9-2711-4462-b085-28791c99901f]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.9590fd97-ece5-4ee0-aa31-6811334aa6bf {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:40 devstack sudo[104381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.9590fd97-ece5-4ee0-aa31-6811334aa6bf
Nov 07 02:46:40 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:41 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.9590fd97-ece5-4ee0-aa31-6811334aa6bf" returned: 0 in 0.392s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:46:41 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[65475fd3-0b79-4cec-9ba0-2e513143de92]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:41 devstack sudo[104386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139
Nov 07 02:46:41 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:41 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139" returned: 0 in 0.418s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139 {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:46:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Creating direct copy from snapshot {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:46:41 devstack cinder-volume[87054]: DEBUG cinder.utils [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Path /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d49d2e87-58d4-4c9b-8183-8119174ca88d not found in is_blk_device check {{(pid=87054) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:46:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d49d2e87-58d4-4c9b-8183-8119174ca88d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:41 devstack sudo[104392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d49d2e87-58d4-4c9b-8183-8119174ca88d
Nov 07 02:46:41 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:48 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d49d2e87-58d4-4c9b-8183-8119174ca88d" returned: 0 in 7.056s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:48 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Image conversion details: src /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139, size 1024.00 MB, duration 7.06 sec, destination /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d49d2e87-58d4-4c9b-8183-8119174ca88d {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:46:48 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Converted 1024.00 MB image at 145.10 MB/s
Nov 07 02:46:48 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d49d2e87-58d4-4c9b-8183-8119174ca88d is being set with open permissions: ugo+rw
Nov 07 02:46:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d49d2e87-58d4-4c9b-8183-8119174ca88d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:48 devstack sudo[104412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d49d2e87-58d4-4c9b-8183-8119174ca88d
Nov 07 02:46:48 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:48 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d49d2e87-58d4-4c9b-8183-8119174ca88d" returned: 0 in 0.270s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Lock "cinder-quobyte-d49d2e87-58d4-4c9b-8183-8119174ca88d" released by "_copy_volume_from_snapshot" :: held 8.238s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Lock "cinder-quobyte-9590fd97-ece5-4ee0-aa31-6811334aa6bf-d49d2e87-58d4-4c9b-8183-8119174ca88d" released by "_create_volume_from_snapshot" :: held 8.301s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.317s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:49 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8dccfd-ffc7-4859-9f76-2d7a045d93f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d49d2e87-58d4-4c9b-8183-8119174ca88d', 'volume_size': 1, 'snapshot_id': '9590fd97-ece5-4ee0-aa31-6811334aa6bf'}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:49 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85d9b8c-3b6f-458e-9be6-74c1b2f085c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:46:49 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Volume volume-d49d2e87-58d4-4c9b-8183-8119174ca88d (d49d2e87-58d4-4c9b-8183-8119174ca88d): created successfully
Nov 07 02:46:49 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85d9b8c-3b6f-458e-9be6-74c1b2f085c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:46:49 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Flow 'volume_create_manager' (44d8c738-fcbe-486c-92e5-006e8aaa7b65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:46:49 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ec4cc998-b4e3-425c-acc0-2d0c73cd26ae tempest-SnapshotDependencyTests-1476829251 None] Created volume successfully.
Nov 07 02:46:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3e13a931-eb55-415c-9955-ecd5c0c6dbb6 tempest-SnapshotDependencyTests-1476829251 None] Acquiring lock "cinder-9590fd97-ece5-4ee0-aa31-6811334aa6bf-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3e13a931-eb55-415c-9955-ecd5c0c6dbb6 tempest-SnapshotDependencyTests-1476829251 None] Lock "cinder-9590fd97-ece5-4ee0-aa31-6811334aa6bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3e13a931-eb55-415c-9955-ecd5c0c6dbb6 tempest-SnapshotDependencyTests-1476829251 None] Acquiring lock "cinder-quobyte-5fcd09a8-b7d1-4988-83de-f3e5f9782139" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3e13a931-eb55-415c-9955-ecd5c0c6dbb6 tempest-SnapshotDependencyTests-1476829251 None] Lock "cinder-quobyte-5fcd09a8-b7d1-4988-83de-f3e5f9782139" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3e13a931-eb55-415c-9955-ecd5c0c6dbb6 tempest-SnapshotDependencyTests-1476829251 None] Acquiring lock "cinder-quobyte-9590fd97-ece5-4ee0-aa31-6811334aa6bf" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3e13a931-eb55-415c-9955-ecd5c0c6dbb6 tempest-SnapshotDependencyTests-1476829251 None] Lock "cinder-quobyte-9590fd97-ece5-4ee0-aa31-6811334aa6bf" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:49 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-3e13a931-eb55-415c-9955-ecd5c0c6dbb6 tempest-SnapshotDependencyTests-1476829251 None] Deleting offline snapshot 9590fd97-ece5-4ee0-aa31-6811334aa6bf of volume 5fcd09a8-b7d1-4988-83de-f3e5f9782139 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:46:49 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-3e13a931-eb55-415c-9955-ecd5c0c6dbb6 tempest-SnapshotDependencyTests-1476829251 None] snapshot_file for this snap is: volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.9590fd97-ece5-4ee0-aa31-6811334aa6bf {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:46:49 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a16ebe-5b8a-4803-b3c1-bb41485468c1]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3e13a931-eb55-415c-9955-ecd5c0c6dbb6 tempest-SnapshotDependencyTests-1476829251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.9590fd97-ece5-4ee0-aa31-6811334aa6bf {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:49 devstack sudo[104415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.9590fd97-ece5-4ee0-aa31-6811334aa6bf
Nov 07 02:46:49 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:49 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3e13a931-eb55-415c-9955-ecd5c0c6dbb6 tempest-SnapshotDependencyTests-1476829251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.9590fd97-ece5-4ee0-aa31-6811334aa6bf" returned: 0 in 0.362s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:49 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-3e13a931-eb55-415c-9955-ecd5c0c6dbb6 tempest-SnapshotDependencyTests-1476829251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:46:49 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[b634a06f-273d-459c-a8c2-b38173ca02f8]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3e13a931-eb55-415c-9955-ecd5c0c6dbb6 tempest-SnapshotDependencyTests-1476829251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:50 devstack sudo[104420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139
Nov 07 02:46:50 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:50 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3e13a931-eb55-415c-9955-ecd5c0c6dbb6 tempest-SnapshotDependencyTests-1476829251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139" returned: 0 in 0.527s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3e13a931-eb55-415c-9955-ecd5c0c6dbb6 tempest-SnapshotDependencyTests-1476829251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.9590fd97-ece5-4ee0-aa31-6811334aa6bf {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:50 devstack sudo[104425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.9590fd97-ece5-4ee0-aa31-6811334aa6bf
Nov 07 02:46:50 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:50 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3e13a931-eb55-415c-9955-ecd5c0c6dbb6 tempest-SnapshotDependencyTests-1476829251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.9590fd97-ece5-4ee0-aa31-6811334aa6bf" returned: 0 in 0.358s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3e13a931-eb55-415c-9955-ecd5c0c6dbb6 tempest-SnapshotDependencyTests-1476829251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.9590fd97-ece5-4ee0-aa31-6811334aa6bf {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:50 devstack sudo[104430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.9590fd97-ece5-4ee0-aa31-6811334aa6bf
Nov 07 02:46:50 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:51 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3e13a931-eb55-415c-9955-ecd5c0c6dbb6 tempest-SnapshotDependencyTests-1476829251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139.9590fd97-ece5-4ee0-aa31-6811334aa6bf" returned: 0 in 0.264s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3e13a931-eb55-415c-9955-ecd5c0c6dbb6 tempest-SnapshotDependencyTests-1476829251 None] Lock "cinder-quobyte-9590fd97-ece5-4ee0-aa31-6811334aa6bf" released by "_delete_snapshot" :: held 1.626s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3e13a931-eb55-415c-9955-ecd5c0c6dbb6 tempest-SnapshotDependencyTests-1476829251 None] Lock "cinder-quobyte-5fcd09a8-b7d1-4988-83de-f3e5f9782139" released by "delete_snapshot" :: held 1.652s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:51 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-3e13a931-eb55-415c-9955-ecd5c0c6dbb6 tempest-SnapshotDependencyTests-1476829251 None] Created reservations ['403a7c3a-bf2f-4596-bf7f-ff9bc3704dd1', 'a0e29c43-4f20-4047-bf20-2d9362be17a3', '4edeca90-5f75-480b-969b-e63886171416', 'c28bf4c6-2ff5-4cdf-ba9a-04b525e3b9b0'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:51 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-3e13a931-eb55-415c-9955-ecd5c0c6dbb6 tempest-SnapshotDependencyTests-1476829251 None] Delete snapshot completed successfully.
Nov 07 02:46:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3e13a931-eb55-415c-9955-ecd5c0c6dbb6 tempest-SnapshotDependencyTests-1476829251 None] Lock "cinder-9590fd97-ece5-4ee0-aa31-6811334aa6bf-delete_snapshot" released by "delete_snapshot" :: held 1.813s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c9197c82-d1e3-4f74-b0b2-d442c63391a7 tempest-SnapshotDependencyTests-1476829251 None] Acquiring lock "cinder-5fcd09a8-b7d1-4988-83de-f3e5f9782139-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c9197c82-d1e3-4f74-b0b2-d442c63391a7 tempest-SnapshotDependencyTests-1476829251 None] Lock "cinder-5fcd09a8-b7d1-4988-83de-f3e5f9782139-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c9197c82-d1e3-4f74-b0b2-d442c63391a7 tempest-SnapshotDependencyTests-1476829251 None] Acquiring lock "cinder-quobyte-5fcd09a8-b7d1-4988-83de-f3e5f9782139" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c9197c82-d1e3-4f74-b0b2-d442c63391a7 tempest-SnapshotDependencyTests-1476829251 None] Lock "cinder-quobyte-5fcd09a8-b7d1-4988-83de-f3e5f9782139" acquired by "delete_volume" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:51 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[3814df03-fa6f-4cff-8577-872e3f217222]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c9197c82-d1e3-4f74-b0b2-d442c63391a7 tempest-SnapshotDependencyTests-1476829251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:51 devstack sudo[104433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139
Nov 07 02:46:51 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:52 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c9197c82-d1e3-4f74-b0b2-d442c63391a7 tempest-SnapshotDependencyTests-1476829251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139" returned: 0 in 0.360s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c9197c82-d1e3-4f74-b0b2-d442c63391a7 tempest-SnapshotDependencyTests-1476829251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:52 devstack sudo[104438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139
Nov 07 02:46:52 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:52 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c9197c82-d1e3-4f74-b0b2-d442c63391a7 tempest-SnapshotDependencyTests-1476829251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5fcd09a8-b7d1-4988-83de-f3e5f9782139" returned: 0 in 0.248s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c9197c82-d1e3-4f74-b0b2-d442c63391a7 tempest-SnapshotDependencyTests-1476829251 None] Lock "cinder-quobyte-5fcd09a8-b7d1-4988-83de-f3e5f9782139" released by "delete_volume" :: held 0.678s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:52 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-c9197c82-d1e3-4f74-b0b2-d442c63391a7 tempest-SnapshotDependencyTests-1476829251 None] Created reservations ['6e738080-fc6e-4e36-b2de-1dcf75a22031', '84f2319b-6fdb-4346-af6d-c404e069f09f', 'f6cedb7f-cf05-4308-b819-d2fa7fbac08c', '7f4b4989-6566-4af4-a965-8cac778f212e'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c9197c82-d1e3-4f74-b0b2-d442c63391a7 tempest-SnapshotDependencyTests-1476829251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c9197c82-d1e3-4f74-b0b2-d442c63391a7 tempest-SnapshotDependencyTests-1476829251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c9197c82-d1e3-4f74-b0b2-d442c63391a7 tempest-SnapshotDependencyTests-1476829251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c9197c82-d1e3-4f74-b0b2-d442c63391a7 tempest-SnapshotDependencyTests-1476829251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c9197c82-d1e3-4f74-b0b2-d442c63391a7 tempest-SnapshotDependencyTests-1476829251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c9197c82-d1e3-4f74-b0b2-d442c63391a7 tempest-SnapshotDependencyTests-1476829251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:52 devstack sudo[104441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:46:52 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:52 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c9197c82-d1e3-4f74-b0b2-d442c63391a7 tempest-SnapshotDependencyTests-1476829251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.267s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:52 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-c9197c82-d1e3-4f74-b0b2-d442c63391a7 tempest-SnapshotDependencyTests-1476829251 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:46:52 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c9197c82-d1e3-4f74-b0b2-d442c63391a7 tempest-SnapshotDependencyTests-1476829251 None] Deleted volume successfully.
Nov 07 02:46:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-84d61f34-fbb3-4337-bc8a-e54a414b0c51 tempest-SnapshotDependencyTests-1476829251 None] Acquiring lock "cinder-d49d2e87-58d4-4c9b-8183-8119174ca88d-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c9197c82-d1e3-4f74-b0b2-d442c63391a7 tempest-SnapshotDependencyTests-1476829251 None] Lock "cinder-5fcd09a8-b7d1-4988-83de-f3e5f9782139-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-84d61f34-fbb3-4337-bc8a-e54a414b0c51 tempest-SnapshotDependencyTests-1476829251 None] Lock "cinder-d49d2e87-58d4-4c9b-8183-8119174ca88d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-84d61f34-fbb3-4337-bc8a-e54a414b0c51 tempest-SnapshotDependencyTests-1476829251 None] Acquiring lock "cinder-quobyte-d49d2e87-58d4-4c9b-8183-8119174ca88d" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:46:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-84d61f34-fbb3-4337-bc8a-e54a414b0c51 tempest-SnapshotDependencyTests-1476829251 None] Lock "cinder-quobyte-d49d2e87-58d4-4c9b-8183-8119174ca88d" acquired by "delete_volume" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:46:52 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b2e24e-ac92-4a96-91a0-182567b44d57]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:46:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-84d61f34-fbb3-4337-bc8a-e54a414b0c51 tempest-SnapshotDependencyTests-1476829251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d49d2e87-58d4-4c9b-8183-8119174ca88d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:53 devstack sudo[104444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d49d2e87-58d4-4c9b-8183-8119174ca88d
Nov 07 02:46:53 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:53 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-84d61f34-fbb3-4337-bc8a-e54a414b0c51 tempest-SnapshotDependencyTests-1476829251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d49d2e87-58d4-4c9b-8183-8119174ca88d" returned: 0 in 0.384s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-84d61f34-fbb3-4337-bc8a-e54a414b0c51 tempest-SnapshotDependencyTests-1476829251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d49d2e87-58d4-4c9b-8183-8119174ca88d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:53 devstack sudo[104449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d49d2e87-58d4-4c9b-8183-8119174ca88d
Nov 07 02:46:53 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:53 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-84d61f34-fbb3-4337-bc8a-e54a414b0c51 tempest-SnapshotDependencyTests-1476829251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d49d2e87-58d4-4c9b-8183-8119174ca88d" returned: 0 in 0.258s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-84d61f34-fbb3-4337-bc8a-e54a414b0c51 tempest-SnapshotDependencyTests-1476829251 None] Lock "cinder-quobyte-d49d2e87-58d4-4c9b-8183-8119174ca88d" released by "delete_volume" :: held 0.688s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:53 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-84d61f34-fbb3-4337-bc8a-e54a414b0c51 tempest-SnapshotDependencyTests-1476829251 None] Created reservations ['29646a73-381d-40f4-b709-b0f889cce490', 'b4184ca4-4333-49c9-bb39-247446a1551e', '9a58159e-b646-4844-aa00-1ee1d161e71e', '88f3e5a4-9c85-4322-ab57-545786c1b78a'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:46:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-84d61f34-fbb3-4337-bc8a-e54a414b0c51 tempest-SnapshotDependencyTests-1476829251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-84d61f34-fbb3-4337-bc8a-e54a414b0c51 tempest-SnapshotDependencyTests-1476829251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-84d61f34-fbb3-4337-bc8a-e54a414b0c51 tempest-SnapshotDependencyTests-1476829251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-84d61f34-fbb3-4337-bc8a-e54a414b0c51 tempest-SnapshotDependencyTests-1476829251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-84d61f34-fbb3-4337-bc8a-e54a414b0c51 tempest-SnapshotDependencyTests-1476829251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-84d61f34-fbb3-4337-bc8a-e54a414b0c51 tempest-SnapshotDependencyTests-1476829251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:53 devstack sudo[104452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:46:53 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:54 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-84d61f34-fbb3-4337-bc8a-e54a414b0c51 tempest-SnapshotDependencyTests-1476829251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.271s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:54 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-84d61f34-fbb3-4337-bc8a-e54a414b0c51 tempest-SnapshotDependencyTests-1476829251 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:46:54 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-84d61f34-fbb3-4337-bc8a-e54a414b0c51 tempest-SnapshotDependencyTests-1476829251 None] Deleted volume successfully.
Nov 07 02:46:54 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-84d61f34-fbb3-4337-bc8a-e54a414b0c51 tempest-SnapshotDependencyTests-1476829251 None] Lock "cinder-d49d2e87-58d4-4c9b-8183-8119174ca88d-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:46:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:46:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:46:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:46:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:46:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:46:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:46:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:46:59 devstack sudo[104457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:46:59 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:46:59 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root
Nov 07 02:46:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.347s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:46:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:46:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:46:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 28 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:46:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>, <Thread(fd_logger, started daemon 125443282798592)>, <Thread(privsep_reader, started daemon 125443284556288)>, <Thread(tpool_thread_0, started daemon 125443276445376)>, <Thread(tpool_thread_1, started daemon 125443268036288)>, <Thread(tpool_thread_2, started daemon 125443259627200)>, <Thread(tpool_thread_3, started daemon 125443251218112)>, <Thread(tpool_thread_4, started daemon 125443242809024)>, <Thread(tpool_thread_5, started daemon 125443234399936)>, <Thread(tpool_thread_6, started daemon 125443225990848)>, <Thread(tpool_thread_7, started daemon 125443217581760)>, <Thread(tpool_thread_8, started daemon 125443209172672)>, <Thread(tpool_thread_9, started daemon 125443200763584)>, <Thread(tpool_thread_10, started daemon 125443192354496)>, <Thread(tpool_thread_11, started daemon 125443183945408)>, <Thread(tpool_thread_12, started daemon 125443175536320)>, <Thread(tpool_thread_13, started daemon 125443167127232)>, <Thread(tpool_thread_14, started daemon 125443158718144)>, <Thread(tpool_thread_15, started daemon 125443150309056)>, <Thread(tpool_thread_16, started daemon 125443141899968)>, <Thread(tpool_thread_17, started daemon 125443133490880)>, <Thread(tpool_thread_18, started daemon 125443125081792)>, <Thread(tpool_thread_19, started daemon 125443116672704)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:47:03 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=30,cinder:INSERT=10,cinder:UPDATE=35,cinder:DELETE=3 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:47:04 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=31,cinder:UPDATE=39,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:47:11 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:47:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Flow 'volume_create_manager' (9151934c-792b-4ce7-a023-2e0624cf47e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:47:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d376736-7d84-4639-b64a-873727e115ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d376736-7d84-4639-b64a-873727e115ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-898543145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1799846c-9a4d-47e7-9220-556758894ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dbac2c1c8a44e168fc09b9f2020146d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:47:12Z,use_quota=True,user_id='f4cc044e515a4bb38325702a6e239cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38bdd77-6d5d-4229-b90b-56523f8e86ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38bdd77-6d5d-4229-b90b-56523f8e86ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83df3b67-4408-48f8-8e82-8a65b954b2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83df3b67-4408-48f8-8e82-8a65b954b2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1799846c-9a4d-47e7-9220-556758894ccd', 'volume_name': 'volume-1799846c-9a4d-47e7-9220-556758894ccd', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e6dce54-b8e2-4d97-814a-b0d305cc5775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e6dce54-b8e2-4d97-814a-b0d305cc5775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c111787c-4b02-4b5d-8a3d-11e98566a490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:11 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Volume 1799846c-9a4d-47e7-9220-556758894ccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1799846c-9a4d-47e7-9220-556758894ccd', 'volume_size': 1}
Nov 07 02:47:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-898543145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1799846c-9a4d-47e7-9220-556758894ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dbac2c1c8a44e168fc09b9f2020146d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:47:12Z,use_quota=True,user_id='f4cc044e515a4bb38325702a6e239cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:47:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Creating volume 1799846c-9a4d-47e7-9220-556758894ccd {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:47:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:47:11 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:47:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1799846c-9a4d-47e7-9220-556758894ccd 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:11 devstack sudo[104501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1799846c-9a4d-47e7-9220-556758894ccd 1073741824
Nov 07 02:47:11 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Flow 'volume_create_manager' (5ce0f948-6d8e-44ac-b743-9c66212d1050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5cc4147-2bb3-4ad7-a44d-6e9d96e0db76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5cc4147-2bb3-4ad7-a44d-6e9d96e0db76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-51014953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d95b2fe-b8e4-40fb-a267-958c343ca4f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dbac2c1c8a44e168fc09b9f2020146d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:47:12Z,use_quota=True,user_id='f4cc044e515a4bb38325702a6e239cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ae2ee9-cc5c-48fd-b0a0-fc24d38cf4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ae2ee9-cc5c-48fd-b0a0-fc24d38cf4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c6a911a-1c77-4038-a2d0-67bb6856bbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c6a911a-1c77-4038-a2d0-67bb6856bbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d95b2fe-b8e4-40fb-a267-958c343ca4f0', 'volume_name': 'volume-5d95b2fe-b8e4-40fb-a267-958c343ca4f0', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21cfe029-c80e-4b02-8b7b-b19e2dfd76b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21cfe029-c80e-4b02-8b7b-b19e2dfd76b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0d3594-62c2-4f05-b3ea-aaac12d4a80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:12 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Volume 5d95b2fe-b8e4-40fb-a267-958c343ca4f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d95b2fe-b8e4-40fb-a267-958c343ca4f0', 'volume_size': 1}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:12 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1799846c-9a4d-47e7-9220-556758894ccd 1073741824" returned: 0 in 0.518s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1799846c-9a4d-47e7-9220-556758894ccd {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:12 devstack sudo[104507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1799846c-9a4d-47e7-9220-556758894ccd
Nov 07 02:47:12 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:12 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1799846c-9a4d-47e7-9220-556758894ccd" returned: 0 in 0.253s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.444s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-51014953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d95b2fe-b8e4-40fb-a267-958c343ca4f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dbac2c1c8a44e168fc09b9f2020146d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:47:12Z,use_quota=True,user_id='f4cc044e515a4bb38325702a6e239cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Creating volume 5d95b2fe-b8e4-40fb-a267-958c343ca4f0 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:47:12 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d95b2fe-b8e4-40fb-a267-958c343ca4f0 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c111787c-4b02-4b5d-8a3d-11e98566a490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1799846c-9a4d-47e7-9220-556758894ccd', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:12 devstack sudo[104510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d95b2fe-b8e4-40fb-a267-958c343ca4f0 1073741824
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482995d7-3fa7-42e8-a076-8f10f1be7ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:12 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:12 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Volume volume-1799846c-9a4d-47e7-9220-556758894ccd (1799846c-9a4d-47e7-9220-556758894ccd): created successfully
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482995d7-3fa7-42e8-a076-8f10f1be7ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Flow 'volume_create_manager' (9151934c-792b-4ce7-a023-2e0624cf47e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:47:12 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ff4338f2-7c18-429c-a35a-4229f633e345 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Created volume successfully.
Nov 07 02:47:13 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d95b2fe-b8e4-40fb-a267-958c343ca4f0 1073741824" returned: 0 in 0.483s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d95b2fe-b8e4-40fb-a267-958c343ca4f0 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:13 devstack sudo[104516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d95b2fe-b8e4-40fb-a267-958c343ca4f0
Nov 07 02:47:13 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:13 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d95b2fe-b8e4-40fb-a267-958c343ca4f0" returned: 0 in 0.240s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:47:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0d3594-62c2-4f05-b3ea-aaac12d4a80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d95b2fe-b8e4-40fb-a267-958c343ca4f0', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba189f73-435b-44f6-8d9a-920d2d01c6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:47:13 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Volume volume-5d95b2fe-b8e4-40fb-a267-958c343ca4f0 (5d95b2fe-b8e4-40fb-a267-958c343ca4f0): created successfully
Nov 07 02:47:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba189f73-435b-44f6-8d9a-920d2d01c6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:47:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Flow 'volume_create_manager' (5ce0f948-6d8e-44ac-b743-9c66212d1050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:47:13 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f4b5bdb8-2a57-4d36-8cc7-b507a7298e96 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Created volume successfully.
Nov 07 02:47:23 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=4,cinder:UPDATE=8 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:47:23 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:47:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-7befb110-fbb2-4b33-86dd-b6ae72add873 req-20b53aa7-7f47-4a91-b5fe-5c7aeadbb464 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-7befb110-fbb2-4b33-86dd-b6ae72add873 req-20b53aa7-7f47-4a91-b5fe-5c7aeadbb464 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-7befb110-fbb2-4b33-86dd-b6ae72add873 req-20b53aa7-7f47-4a91-b5fe-5c7aeadbb464 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-7befb110-fbb2-4b33-86dd-b6ae72add873 req-20b53aa7-7f47-4a91-b5fe-5c7aeadbb464 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c', 'name': 'volume-1799846c-9a4d-47e7-9220-556758894ccd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c5b4ca8-5de6-47cf-b477-285e9f7d2cbe', 'enforce_multipath': True} {{(pid=87054) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:47:43 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-7befb110-fbb2-4b33-86dd-b6ae72add873 req-20b53aa7-7f47-4a91-b5fe-5c7aeadbb464 tempest-TestServerVolumeAttachmentScenario-1787943423 None] attachment_update completed successfully.
Nov 07 02:47:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-d4b1c8f9-78a6-4b66-96ed-1324bdb73273 req-66da602d-f5ca-4162-84a1-712907625ecf tempest-TestServerVolumeAttachmentScenario-1787943423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-d4b1c8f9-78a6-4b66-96ed-1324bdb73273 req-66da602d-f5ca-4162-84a1-712907625ecf tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-d4b1c8f9-78a6-4b66-96ed-1324bdb73273 req-66da602d-f5ca-4162-84a1-712907625ecf tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-d4b1c8f9-78a6-4b66-96ed-1324bdb73273 req-66da602d-f5ca-4162-84a1-712907625ecf tempest-TestServerVolumeAttachmentScenario-1787943423 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c', 'name': 'volume-5d95b2fe-b8e4-40fb-a267-958c343ca4f0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68c2ded9-54cd-4964-8ab1-6b32f9fe6175', 'enforce_multipath': True} {{(pid=87054) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:47:46 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-d4b1c8f9-78a6-4b66-96ed-1324bdb73273 req-66da602d-f5ca-4162-84a1-712907625ecf tempest-TestServerVolumeAttachmentScenario-1787943423 None] attachment_update completed successfully.
Nov 07 02:47:47 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-04bb50d1-40af-4bbf-aaf9-303089120672 req-d1073a07-feac-49f4-ba72-6736d75aa543 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Terminate volume connection completed successfully.
Nov 07 02:47:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-04bb50d1-40af-4bbf-aaf9-303089120672 req-d1073a07-feac-49f4-ba72-6736d75aa543 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Deleting attachment 68c2ded9-54cd-4964-8ab1-6b32f9fe6175. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:47:49 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-fe55d5a8-eec2-4cf1-a894-9a137f900079 req-5fd808a3-73c4-440f-851c-dea19e71a113 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Terminate volume connection completed successfully.
Nov 07 02:47:49 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-fe55d5a8-eec2-4cf1-a894-9a137f900079 req-5fd808a3-73c4-440f-851c-dea19e71a113 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Deleting attachment 2c5b4ca8-5de6-47cf-b477-285e9f7d2cbe. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:47:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-05237931-5a70-4e15-b038-8df67df54f55 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Acquiring lock "cinder-5d95b2fe-b8e4-40fb-a267-958c343ca4f0-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-05237931-5a70-4e15-b038-8df67df54f55 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "cinder-5d95b2fe-b8e4-40fb-a267-958c343ca4f0-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-05237931-5a70-4e15-b038-8df67df54f55 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Acquiring lock "cinder-quobyte-5d95b2fe-b8e4-40fb-a267-958c343ca4f0" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-05237931-5a70-4e15-b038-8df67df54f55 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "cinder-quobyte-5d95b2fe-b8e4-40fb-a267-958c343ca4f0" acquired by "delete_volume" :: waited 0.013s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:53 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[023bb70b-d846-4c66-8f80-cd8596050e36]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:47:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-05237931-5a70-4e15-b038-8df67df54f55 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d95b2fe-b8e4-40fb-a267-958c343ca4f0 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:53 devstack sudo[105137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d95b2fe-b8e4-40fb-a267-958c343ca4f0
Nov 07 02:47:53 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:54 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-05237931-5a70-4e15-b038-8df67df54f55 tempest-TestServerVolumeAttachmentScenario-1787943423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d95b2fe-b8e4-40fb-a267-958c343ca4f0" returned: 0 in 0.343s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-05237931-5a70-4e15-b038-8df67df54f55 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d95b2fe-b8e4-40fb-a267-958c343ca4f0 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:54 devstack sudo[105142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d95b2fe-b8e4-40fb-a267-958c343ca4f0
Nov 07 02:47:54 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:54 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-05237931-5a70-4e15-b038-8df67df54f55 tempest-TestServerVolumeAttachmentScenario-1787943423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5d95b2fe-b8e4-40fb-a267-958c343ca4f0" returned: 0 in 0.256s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:54 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-05237931-5a70-4e15-b038-8df67df54f55 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "cinder-quobyte-5d95b2fe-b8e4-40fb-a267-958c343ca4f0" released by "delete_volume" :: held 0.636s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:54 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-05237931-5a70-4e15-b038-8df67df54f55 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Created reservations ['8bbc5e84-a6c4-4fee-b562-a64c37753ac0', '446e2372-3726-43b7-89c4-1591f1872dc9', '0cffe0c1-b0e6-4b23-9411-edca1a5db991', 'b40337c4-9765-473a-92b9-dce63ce4ddab'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:47:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-05237931-5a70-4e15-b038-8df67df54f55 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-05237931-5a70-4e15-b038-8df67df54f55 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-05237931-5a70-4e15-b038-8df67df54f55 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-05237931-5a70-4e15-b038-8df67df54f55 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-05237931-5a70-4e15-b038-8df67df54f55 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-05237931-5a70-4e15-b038-8df67df54f55 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:54 devstack sudo[105145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:47:54 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:54 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-05237931-5a70-4e15-b038-8df67df54f55 tempest-TestServerVolumeAttachmentScenario-1787943423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.231s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:54 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-05237931-5a70-4e15-b038-8df67df54f55 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:47:54 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-05237931-5a70-4e15-b038-8df67df54f55 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Deleted volume successfully.
Nov 07 02:47:54 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-05237931-5a70-4e15-b038-8df67df54f55 tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "cinder-5d95b2fe-b8e4-40fb-a267-958c343ca4f0-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:54 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a560ad30-209b-4f59-931f-f11a557a3fba tempest-TestServerVolumeAttachmentScenario-1787943423 None] Acquiring lock "cinder-1799846c-9a4d-47e7-9220-556758894ccd-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:54 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a560ad30-209b-4f59-931f-f11a557a3fba tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "cinder-1799846c-9a4d-47e7-9220-556758894ccd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:54 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a560ad30-209b-4f59-931f-f11a557a3fba tempest-TestServerVolumeAttachmentScenario-1787943423 None] Acquiring lock "cinder-quobyte-1799846c-9a4d-47e7-9220-556758894ccd" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:47:54 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a560ad30-209b-4f59-931f-f11a557a3fba tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "cinder-quobyte-1799846c-9a4d-47e7-9220-556758894ccd" acquired by "delete_volume" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:47:54 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f1cb19-8ab9-493e-aac2-7a391dcf3e54]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:47:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a560ad30-209b-4f59-931f-f11a557a3fba tempest-TestServerVolumeAttachmentScenario-1787943423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1799846c-9a4d-47e7-9220-556758894ccd {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:55 devstack sudo[105148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1799846c-9a4d-47e7-9220-556758894ccd
Nov 07 02:47:55 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:55 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a560ad30-209b-4f59-931f-f11a557a3fba tempest-TestServerVolumeAttachmentScenario-1787943423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1799846c-9a4d-47e7-9220-556758894ccd" returned: 0 in 0.352s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a560ad30-209b-4f59-931f-f11a557a3fba tempest-TestServerVolumeAttachmentScenario-1787943423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1799846c-9a4d-47e7-9220-556758894ccd {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:55 devstack sudo[105153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1799846c-9a4d-47e7-9220-556758894ccd
Nov 07 02:47:55 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:55 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a560ad30-209b-4f59-931f-f11a557a3fba tempest-TestServerVolumeAttachmentScenario-1787943423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1799846c-9a4d-47e7-9220-556758894ccd" returned: 0 in 0.234s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:55 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a560ad30-209b-4f59-931f-f11a557a3fba tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "cinder-quobyte-1799846c-9a4d-47e7-9220-556758894ccd" released by "delete_volume" :: held 0.624s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:55 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-a560ad30-209b-4f59-931f-f11a557a3fba tempest-TestServerVolumeAttachmentScenario-1787943423 None] Created reservations ['4ef46584-021e-425a-87a9-c50e7c07cbfc', '53c55807-5f12-4b60-8c3a-a4a1968fd454', '733e4992-2b7b-42d1-830d-ef107fbf70a6', 'c84dbeec-411b-4a91-9b4c-d756353479d0'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:47:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a560ad30-209b-4f59-931f-f11a557a3fba tempest-TestServerVolumeAttachmentScenario-1787943423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a560ad30-209b-4f59-931f-f11a557a3fba tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a560ad30-209b-4f59-931f-f11a557a3fba tempest-TestServerVolumeAttachmentScenario-1787943423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a560ad30-209b-4f59-931f-f11a557a3fba tempest-TestServerVolumeAttachmentScenario-1787943423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a560ad30-209b-4f59-931f-f11a557a3fba tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a560ad30-209b-4f59-931f-f11a557a3fba tempest-TestServerVolumeAttachmentScenario-1787943423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:55 devstack sudo[105156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:47:55 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:55 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a560ad30-209b-4f59-931f-f11a557a3fba tempest-TestServerVolumeAttachmentScenario-1787943423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.234s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:55 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-a560ad30-209b-4f59-931f-f11a557a3fba tempest-TestServerVolumeAttachmentScenario-1787943423 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:47:55 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-a560ad30-209b-4f59-931f-f11a557a3fba tempest-TestServerVolumeAttachmentScenario-1787943423 None] Deleted volume successfully.
Nov 07 02:47:55 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a560ad30-209b-4f59-931f-f11a557a3fba tempest-TestServerVolumeAttachmentScenario-1787943423 None] Lock "cinder-1799846c-9a4d-47e7-9220-556758894ccd-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:47:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:47:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:47:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:47:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:47:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:47:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:47:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:47:59 devstack sudo[105161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:47:59 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:47:59 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root
Nov 07 02:47:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.251s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:47:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:47:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:47:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 28 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:47:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>, <Thread(fd_logger, started daemon 125443282798592)>, <Thread(privsep_reader, started daemon 125443284556288)>, <Thread(tpool_thread_0, started daemon 125443276445376)>, <Thread(tpool_thread_1, started daemon 125443268036288)>, <Thread(tpool_thread_2, started daemon 125443259627200)>, <Thread(tpool_thread_3, started daemon 125443251218112)>, <Thread(tpool_thread_4, started daemon 125443242809024)>, <Thread(tpool_thread_5, started daemon 125443234399936)>, <Thread(tpool_thread_6, started daemon 125443225990848)>, <Thread(tpool_thread_7, started daemon 125443217581760)>, <Thread(tpool_thread_8, started daemon 125443209172672)>, <Thread(tpool_thread_9, started daemon 125443200763584)>, <Thread(tpool_thread_10, started daemon 125443192354496)>, <Thread(tpool_thread_11, started daemon 125443183945408)>, <Thread(tpool_thread_12, started daemon 125443175536320)>, <Thread(tpool_thread_13, started daemon 125443167127232)>, <Thread(tpool_thread_14, started daemon 125443158718144)>, <Thread(tpool_thread_15, started daemon 125443150309056)>, <Thread(tpool_thread_16, started daemon 125443141899968)>, <Thread(tpool_thread_17, started daemon 125443133490880)>, <Thread(tpool_thread_18, started daemon 125443125081792)>, <Thread(tpool_thread_19, started daemon 125443116672704)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:48:05 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=26,cinder:UPDATE=16,cinder:INSERT=4 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:48:05 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=25,cinder:UPDATE=23,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:48:26 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:48:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Flow 'volume_create_manager' (219b3313-9544-4030-8671-a63ae0b5cef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:48:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f509aef-733b-435e-b9a2-4ce5fd575508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f509aef-733b-435e-b9a2-4ce5fd575508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1244322534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c733d7-dbcf-4f5d-a541-92e03f9e05cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84ff601b2f8401a9271face157970e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:48:27Z,use_quota=True,user_id='18fdc65fe5a641cc8542755c78f68595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc8a5cf-f7c4-40a4-b2b3-2c31f8429521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc8a5cf-f7c4-40a4-b2b3-2c31f8429521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d2d7fa5-6621-4e87-809e-0270ef8e1e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d2d7fa5-6621-4e87-809e-0270ef8e1e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46c733d7-dbcf-4f5d-a541-92e03f9e05cd', 'volume_name': 'volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f79bf6-a086-43bc-944b-e5fdd5ba1fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f79bf6-a086-43bc-944b-e5fdd5ba1fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c92b6d9-a9dd-4c53-92cd-44d3d489fe0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:26 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Volume 46c733d7-dbcf-4f5d-a541-92e03f9e05cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd', 'volume_size': 1}
Nov 07 02:48:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1244322534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c733d7-dbcf-4f5d-a541-92e03f9e05cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84ff601b2f8401a9271face157970e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:48:27Z,use_quota=True,user_id='18fdc65fe5a641cc8542755c78f68595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:48:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Creating volume 46c733d7-dbcf-4f5d-a541-92e03f9e05cd {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:48:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:48:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:48:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:48:26 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:48:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:26 devstack sudo[105212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd 1073741824
Nov 07 02:48:26 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:27 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd 1073741824" returned: 0 in 0.454s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:27 devstack sudo[105218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd
Nov 07 02:48:27 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:27 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd" returned: 0 in 0.264s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:48:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c92b6d9-a9dd-4c53-92cd-44d3d489fe0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60fa58c8-d75b-49f5-9ba0-27eaf04e2473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:48:27 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Volume volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd (46c733d7-dbcf-4f5d-a541-92e03f9e05cd): created successfully
Nov 07 02:48:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60fa58c8-d75b-49f5-9ba0-27eaf04e2473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:48:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Flow 'volume_create_manager' (219b3313-9544-4030-8671-a63ae0b5cef2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:48:27 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c1cb78ae-bb30-434a-b80e-b8471b9eda01 tempest-TestStampPattern-1708731291 None] Created volume successfully.
Nov 07 02:48:37 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:48:37 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:48:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-fbd009bb-3c52-4468-a260-ea2a3cd6f050 req-79458e1d-db92-4f7d-9305-9f76ac384c4f tempest-TestStampPattern-1708731291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-fbd009bb-3c52-4468-a260-ea2a3cd6f050 req-79458e1d-db92-4f7d-9305-9f76ac384c4f tempest-TestStampPattern-1708731291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-fbd009bb-3c52-4468-a260-ea2a3cd6f050 req-79458e1d-db92-4f7d-9305-9f76ac384c4f tempest-TestStampPattern-1708731291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:56 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-fbd009bb-3c52-4468-a260-ea2a3cd6f050 req-79458e1d-db92-4f7d-9305-9f76ac384c4f tempest-TestStampPattern-1708731291 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c', 'name': 'volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad6ea25e-edc7-44d4-94ec-f82d59c66bd3', 'enforce_multipath': True} {{(pid=87054) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:48:56 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-fbd009bb-3c52-4468-a260-ea2a3cd6f050 req-79458e1d-db92-4f7d-9305-9f76ac384c4f tempest-TestStampPattern-1708731291 None] attachment_update completed successfully.
Nov 07 02:48:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:48:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:48:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:48:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:48:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:48:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:48:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:48:59 devstack sudo[105796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:48:59 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:48:59 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root
Nov 07 02:48:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.268s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:48:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:48:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:48:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 28 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:48:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>, <Thread(fd_logger, started daemon 125443282798592)>, <Thread(privsep_reader, started daemon 125443284556288)>, <Thread(tpool_thread_0, started daemon 125443276445376)>, <Thread(tpool_thread_1, started daemon 125443268036288)>, <Thread(tpool_thread_2, started daemon 125443259627200)>, <Thread(tpool_thread_3, started daemon 125443251218112)>, <Thread(tpool_thread_4, started daemon 125443242809024)>, <Thread(tpool_thread_5, started daemon 125443234399936)>, <Thread(tpool_thread_6, started daemon 125443225990848)>, <Thread(tpool_thread_7, started daemon 125443217581760)>, <Thread(tpool_thread_8, started daemon 125443209172672)>, <Thread(tpool_thread_9, started daemon 125443200763584)>, <Thread(tpool_thread_10, started daemon 125443192354496)>, <Thread(tpool_thread_11, started daemon 125443183945408)>, <Thread(tpool_thread_12, started daemon 125443175536320)>, <Thread(tpool_thread_13, started daemon 125443167127232)>, <Thread(tpool_thread_14, started daemon 125443158718144)>, <Thread(tpool_thread_15, started daemon 125443150309056)>, <Thread(tpool_thread_16, started daemon 125443141899968)>, <Thread(tpool_thread_17, started daemon 125443133490880)>, <Thread(tpool_thread_18, started daemon 125443125081792)>, <Thread(tpool_thread_19, started daemon 125443116672704)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:49:00 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-4b959615-ce40-4f3a-aa22-9df58de4ebd1 req-9dc440f9-e1be-443d-838c-3f10231df8d7 tempest-TestStampPattern-1708731291 None] Terminate volume connection completed successfully.
Nov 07 02:49:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-4b959615-ce40-4f3a-aa22-9df58de4ebd1 req-9dc440f9-e1be-443d-838c-3f10231df8d7 tempest-TestStampPattern-1708731291 None] Deleting attachment ad6ea25e-edc7-44d4-94ec-f82d59c66bd3. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:49:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b9cff521-714d-4cf7-8204-21df890ccb1c tempest-TestStampPattern-1708731291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b9cff521-714d-4cf7-8204-21df890ccb1c tempest-TestStampPattern-1708731291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:01 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-b9cff521-714d-4cf7-8204-21df890ccb1c tempest-TestStampPattern-1708731291 None] Creating offline snapshot 189c1ec3-c4d7-437b-8321-4f2c1f4ea91e of volume 46c733d7-dbcf-4f5d-a541-92e03f9e05cd {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:49:01 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a09a9c-f8b1-49de-aa43-d661ce30fc45]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:49:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9cff521-714d-4cf7-8204-21df890ccb1c tempest-TestStampPattern-1708731291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:01 devstack sudo[105834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd
Nov 07 02:49:01 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:01 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9cff521-714d-4cf7-8204-21df890ccb1c tempest-TestStampPattern-1708731291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd" returned: 0 in 0.351s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9cff521-714d-4cf7-8204-21df890ccb1c tempest-TestStampPattern-1708731291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.189c1ec3-c4d7-437b-8321-4f2c1f4ea91e 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:01 devstack sudo[105839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.189c1ec3-c4d7-437b-8321-4f2c1f4ea91e 1G
Nov 07 02:49:01 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:01 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9cff521-714d-4cf7-8204-21df890ccb1c tempest-TestStampPattern-1708731291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.189c1ec3-c4d7-437b-8321-4f2c1f4ea91e 1G" returned: 0 in 0.382s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9cff521-714d-4cf7-8204-21df890ccb1c tempest-TestStampPattern-1708731291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.189c1ec3-c4d7-437b-8321-4f2c1f4ea91e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:01 devstack sudo[105844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.189c1ec3-c4d7-437b-8321-4f2c1f4ea91e
Nov 07 02:49:01 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:02 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9cff521-714d-4cf7-8204-21df890ccb1c tempest-TestStampPattern-1708731291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.189c1ec3-c4d7-437b-8321-4f2c1f4ea91e" returned: 0 in 0.280s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:02 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-b9cff521-714d-4cf7-8204-21df890ccb1c tempest-TestStampPattern-1708731291 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.189c1ec3-c4d7-437b-8321-4f2c1f4ea91e is being set with open permissions: ugo+rw
Nov 07 02:49:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9cff521-714d-4cf7-8204-21df890ccb1c tempest-TestStampPattern-1708731291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.189c1ec3-c4d7-437b-8321-4f2c1f4ea91e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:02 devstack sudo[105849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.189c1ec3-c4d7-437b-8321-4f2c1f4ea91e
Nov 07 02:49:02 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:02 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9cff521-714d-4cf7-8204-21df890ccb1c tempest-TestStampPattern-1708731291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.189c1ec3-c4d7-437b-8321-4f2c1f4ea91e" returned: 0 in 0.231s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9cff521-714d-4cf7-8204-21df890ccb1c tempest-TestStampPattern-1708731291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:02 devstack sudo[105852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.info
Nov 07 02:49:02 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:02 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9cff521-714d-4cf7-8204-21df890ccb1c tempest-TestStampPattern-1708731291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.info" returned: 0 in 0.240s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:02 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-b9cff521-714d-4cf7-8204-21df890ccb1c tempest-TestStampPattern-1708731291 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.info is being set with open permissions: ugo+rw
Nov 07 02:49:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9cff521-714d-4cf7-8204-21df890ccb1c tempest-TestStampPattern-1708731291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:02 devstack sudo[105855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.info
Nov 07 02:49:02 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:02 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9cff521-714d-4cf7-8204-21df890ccb1c tempest-TestStampPattern-1708731291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.info" returned: 0 in 0.231s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b9cff521-714d-4cf7-8204-21df890ccb1c tempest-TestStampPattern-1708731291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.797s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:02 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b9cff521-714d-4cf7-8204-21df890ccb1c tempest-TestStampPattern-1708731291 None] Create snapshot completed successfully
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Flow 'volume_create_manager' (353e9039-436f-40f1-92e8-e1804facc415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528aa7c9-7e78-4f32-bb23-97813e0cfb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528aa7c9-7e78-4f32-bb23-97813e0cfb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1648332383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae9bbb6b-475a-4cd7-99bc-e8a21b238cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84ff601b2f8401a9271face157970e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=189c1ec3-c4d7-437b-8321-4f2c1f4ea91e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:49:09Z,use_quota=True,user_id='18fdc65fe5a641cc8542755c78f68595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ad369f-f803-4c37-b3f8-86d965a13bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ad369f-f803-4c37-b3f8-86d965a13bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f715a6-d16b-453f-a19c-592ae188e1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f715a6-d16b-453f-a19c-592ae188e1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ae9bbb6b-475a-4cd7-99bc-e8a21b238cac', 'volume_name': 'volume-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac', 'volume_size': 1, 'snapshot_id': '189c1ec3-c4d7-437b-8321-4f2c1f4ea91e'}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef41c889-092c-42ed-866e-86eb275cd3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef41c889-092c-42ed-866e-86eb275cd3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df21f44a-bce1-49c4-b1e6-08b4ddf4ab45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:08 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Volume ae9bbb6b-475a-4cd7-99bc-e8a21b238cac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac', 'volume_size': 1, 'snapshot_id': '189c1ec3-c4d7-437b-8321-4f2c1f4ea91e'}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Acquiring lock "cinder-quobyte-189c1ec3-c4d7-437b-8321-4f2c1f4ea91e-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac" by "_create_volume_from_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Lock "cinder-quobyte-189c1ec3-c4d7-437b-8321-4f2c1f4ea91e-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Creating volume ae9bbb6b-475a-4cd7-99bc-e8a21b238cac from snapshot 189c1ec3-c4d7-437b-8321-4f2c1f4ea91e {{(pid=87054) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Acquiring lock "cinder-quobyte-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac" by "_copy_volume_from_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Lock "cinder-quobyte-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] snapshot: 189c1ec3-c4d7-437b-8321-4f2c1f4ea91e, volume: ae9bbb6b-475a-4cd7-99bc-e8a21b238cac,  {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2f7d4a-8c62-4ecf-81f4-f74d14990816]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:49:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.189c1ec3-c4d7-437b-8321-4f2c1f4ea91e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:09 devstack sudo[105919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.189c1ec3-c4d7-437b-8321-4f2c1f4ea91e
Nov 07 02:49:09 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:09 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.189c1ec3-c4d7-437b-8321-4f2c1f4ea91e" returned: 0 in 0.379s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:49:09 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d96d71-690e-4e33-8403-5067abdd478b]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:49:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:09 devstack sudo[105925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd
Nov 07 02:49:09 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:09 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd" returned: 0 in 0.369s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:49:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Creating direct copy from snapshot {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:49:09 devstack cinder-volume[87054]: DEBUG cinder.utils [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Path /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac not found in is_blk_device check {{(pid=87054) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:49:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:09 devstack sudo[105932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac
Nov 07 02:49:09 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:18 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac" returned: 0 in 8.930s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:18 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Image conversion details: src /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd, size 1024.00 MB, duration 8.93 sec, destination /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:49:18 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Converted 1024.00 MB image at 114.65 MB/s
Nov 07 02:49:18 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac is being set with open permissions: ugo+rw
Nov 07 02:49:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:18 devstack sudo[106023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac
Nov 07 02:49:18 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:18 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=14,cinder:UPDATE=5 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:49:18 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=12,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:49:18 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac" returned: 0 in 0.257s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Lock "cinder-quobyte-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac" released by "_copy_volume_from_snapshot" :: held 10.030s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Lock "cinder-quobyte-189c1ec3-c4d7-437b-8321-4f2c1f4ea91e-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac" released by "_create_volume_from_snapshot" :: held 10.095s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.113s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df21f44a-bce1-49c4-b1e6-08b4ddf4ab45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac', 'volume_size': 1, 'snapshot_id': '189c1ec3-c4d7-437b-8321-4f2c1f4ea91e'}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d399ae-ecb5-4f48-8658-c636286261b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:49:19 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Volume volume-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac (ae9bbb6b-475a-4cd7-99bc-e8a21b238cac): created successfully
Nov 07 02:49:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d399ae-ecb5-4f48-8658-c636286261b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:49:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Flow 'volume_create_manager' (353e9039-436f-40f1-92e8-e1804facc415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:49:19 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-aee525dc-35c5-4f09-be5f-15ca9fe195ef tempest-TestStampPattern-1708731291 None] Created volume successfully.
Nov 07 02:49:29 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:UPDATE=4 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:49:29 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:49:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-c626c08b-8648-49e6-aba0-ef01b0ffff72 req-07f68358-43de-4ceb-b983-58808aeb6d00 tempest-TestStampPattern-1708731291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-c626c08b-8648-49e6-aba0-ef01b0ffff72 req-07f68358-43de-4ceb-b983-58808aeb6d00 tempest-TestStampPattern-1708731291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [req-c626c08b-8648-49e6-aba0-ef01b0ffff72 req-07f68358-43de-4ceb-b983-58808aeb6d00 tempest-TestStampPattern-1708731291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-c626c08b-8648-49e6-aba0-ef01b0ffff72 req-07f68358-43de-4ceb-b983-58808aeb6d00 tempest-TestStampPattern-1708731291 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c', 'name': 'volume-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98b5d44e-0491-4a2d-94ee-53e7221135fd', 'enforce_multipath': True} {{(pid=87054) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 07 02:49:45 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-c626c08b-8648-49e6-aba0-ef01b0ffff72 req-07f68358-43de-4ceb-b983-58808aeb6d00 tempest-TestStampPattern-1708731291 None] attachment_update completed successfully.
Nov 07 02:49:47 devstack cinder-volume[87054]: INFO cinder.volume.manager [req-257aa259-f297-4084-9373-dd342fe5b98c req-a5c4c560-f57f-47a1-94dc-c0e713bef0ca tempest-TestStampPattern-1708731291 None] Terminate volume connection completed successfully.
Nov 07 02:49:47 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [req-257aa259-f297-4084-9373-dd342fe5b98c req-a5c4c560-f57f-47a1-94dc-c0e713bef0ca tempest-TestStampPattern-1708731291 None] Deleting attachment 98b5d44e-0491-4a2d-94ee-53e7221135fd. {{(pid=87054) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 07 02:49:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0e14d9a2-ec4a-47c3-b1e6-71acaddec750 tempest-TestStampPattern-1708731291 None] Acquiring lock "cinder-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0e14d9a2-ec4a-47c3-b1e6-71acaddec750 tempest-TestStampPattern-1708731291 None] Lock "cinder-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0e14d9a2-ec4a-47c3-b1e6-71acaddec750 tempest-TestStampPattern-1708731291 None] Acquiring lock "cinder-quobyte-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0e14d9a2-ec4a-47c3-b1e6-71acaddec750 tempest-TestStampPattern-1708731291 None] Lock "cinder-quobyte-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac" acquired by "delete_volume" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:52 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0e71fa-351a-43e1-909a-6a8e250c269d]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:49:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0e14d9a2-ec4a-47c3-b1e6-71acaddec750 tempest-TestStampPattern-1708731291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:52 devstack sudo[106543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac
Nov 07 02:49:52 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:52 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0e14d9a2-ec4a-47c3-b1e6-71acaddec750 tempest-TestStampPattern-1708731291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac" returned: 0 in 0.358s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0e14d9a2-ec4a-47c3-b1e6-71acaddec750 tempest-TestStampPattern-1708731291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:52 devstack sudo[106548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac
Nov 07 02:49:52 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:52 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0e14d9a2-ec4a-47c3-b1e6-71acaddec750 tempest-TestStampPattern-1708731291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac" returned: 0 in 0.257s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0e14d9a2-ec4a-47c3-b1e6-71acaddec750 tempest-TestStampPattern-1708731291 None] Lock "cinder-quobyte-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac" released by "delete_volume" :: held 0.657s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:52 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-0e14d9a2-ec4a-47c3-b1e6-71acaddec750 tempest-TestStampPattern-1708731291 None] Created reservations ['5968bee2-8427-428e-b503-9fc782db88a9', '3dc49e1c-a59b-4cf1-81fb-f27ca15f91de', '136652e8-568d-42bc-a6b8-a81f9ca27888', '34b8712e-c4da-4902-8a55-8783e89bf0ea'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:49:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0e14d9a2-ec4a-47c3-b1e6-71acaddec750 tempest-TestStampPattern-1708731291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0e14d9a2-ec4a-47c3-b1e6-71acaddec750 tempest-TestStampPattern-1708731291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0e14d9a2-ec4a-47c3-b1e6-71acaddec750 tempest-TestStampPattern-1708731291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:49:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0e14d9a2-ec4a-47c3-b1e6-71acaddec750 tempest-TestStampPattern-1708731291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:49:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0e14d9a2-ec4a-47c3-b1e6-71acaddec750 tempest-TestStampPattern-1708731291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0e14d9a2-ec4a-47c3-b1e6-71acaddec750 tempest-TestStampPattern-1708731291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:52 devstack sudo[106556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:49:52 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:53 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0e14d9a2-ec4a-47c3-b1e6-71acaddec750 tempest-TestStampPattern-1708731291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.269s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:53 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-0e14d9a2-ec4a-47c3-b1e6-71acaddec750 tempest-TestStampPattern-1708731291 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:49:53 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-0e14d9a2-ec4a-47c3-b1e6-71acaddec750 tempest-TestStampPattern-1708731291 None] Deleted volume successfully.
Nov 07 02:49:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0e14d9a2-ec4a-47c3-b1e6-71acaddec750 tempest-TestStampPattern-1708731291 None] Lock "cinder-ae9bbb6b-475a-4cd7-99bc-e8a21b238cac-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-767ff303-d467-4146-9f81-c1c27d6340cf tempest-TestStampPattern-1708731291 None] Acquiring lock "cinder-189c1ec3-c4d7-437b-8321-4f2c1f4ea91e-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-767ff303-d467-4146-9f81-c1c27d6340cf tempest-TestStampPattern-1708731291 None] Lock "cinder-189c1ec3-c4d7-437b-8321-4f2c1f4ea91e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-767ff303-d467-4146-9f81-c1c27d6340cf tempest-TestStampPattern-1708731291 None] Acquiring lock "cinder-quobyte-46c733d7-dbcf-4f5d-a541-92e03f9e05cd" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-767ff303-d467-4146-9f81-c1c27d6340cf tempest-TestStampPattern-1708731291 None] Lock "cinder-quobyte-46c733d7-dbcf-4f5d-a541-92e03f9e05cd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-767ff303-d467-4146-9f81-c1c27d6340cf tempest-TestStampPattern-1708731291 None] Acquiring lock "cinder-quobyte-189c1ec3-c4d7-437b-8321-4f2c1f4ea91e" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-767ff303-d467-4146-9f81-c1c27d6340cf tempest-TestStampPattern-1708731291 None] Lock "cinder-quobyte-189c1ec3-c4d7-437b-8321-4f2c1f4ea91e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-767ff303-d467-4146-9f81-c1c27d6340cf tempest-TestStampPattern-1708731291 None] Deleting offline snapshot 189c1ec3-c4d7-437b-8321-4f2c1f4ea91e of volume 46c733d7-dbcf-4f5d-a541-92e03f9e05cd {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:49:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-767ff303-d467-4146-9f81-c1c27d6340cf tempest-TestStampPattern-1708731291 None] snapshot_file for this snap is: volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.189c1ec3-c4d7-437b-8321-4f2c1f4ea91e {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:49:53 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[8292a0cd-809b-4eb7-be03-832830dc2cbe]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:49:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-767ff303-d467-4146-9f81-c1c27d6340cf tempest-TestStampPattern-1708731291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.189c1ec3-c4d7-437b-8321-4f2c1f4ea91e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:53 devstack sudo[106562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.189c1ec3-c4d7-437b-8321-4f2c1f4ea91e
Nov 07 02:49:53 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:53 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-767ff303-d467-4146-9f81-c1c27d6340cf tempest-TestStampPattern-1708731291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.189c1ec3-c4d7-437b-8321-4f2c1f4ea91e" returned: 0 in 0.339s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-767ff303-d467-4146-9f81-c1c27d6340cf tempest-TestStampPattern-1708731291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:49:54 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[869ccd1a-43c9-4b68-9826-d5b0326c1717]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:49:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-767ff303-d467-4146-9f81-c1c27d6340cf tempest-TestStampPattern-1708731291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:54 devstack sudo[106567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd
Nov 07 02:49:54 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:54 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-767ff303-d467-4146-9f81-c1c27d6340cf tempest-TestStampPattern-1708731291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd" returned: 0 in 0.515s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-767ff303-d467-4146-9f81-c1c27d6340cf tempest-TestStampPattern-1708731291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.189c1ec3-c4d7-437b-8321-4f2c1f4ea91e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:54 devstack sudo[106572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.189c1ec3-c4d7-437b-8321-4f2c1f4ea91e
Nov 07 02:49:54 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:54 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-767ff303-d467-4146-9f81-c1c27d6340cf tempest-TestStampPattern-1708731291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.189c1ec3-c4d7-437b-8321-4f2c1f4ea91e" returned: 0 in 0.342s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-767ff303-d467-4146-9f81-c1c27d6340cf tempest-TestStampPattern-1708731291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.189c1ec3-c4d7-437b-8321-4f2c1f4ea91e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:54 devstack sudo[106577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.189c1ec3-c4d7-437b-8321-4f2c1f4ea91e
Nov 07 02:49:54 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:55 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-767ff303-d467-4146-9f81-c1c27d6340cf tempest-TestStampPattern-1708731291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd.189c1ec3-c4d7-437b-8321-4f2c1f4ea91e" returned: 0 in 0.246s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:55 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-767ff303-d467-4146-9f81-c1c27d6340cf tempest-TestStampPattern-1708731291 None] Lock "cinder-quobyte-189c1ec3-c4d7-437b-8321-4f2c1f4ea91e" released by "_delete_snapshot" :: held 1.538s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:55 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-767ff303-d467-4146-9f81-c1c27d6340cf tempest-TestStampPattern-1708731291 None] Lock "cinder-quobyte-46c733d7-dbcf-4f5d-a541-92e03f9e05cd" released by "delete_snapshot" :: held 1.566s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:55 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-767ff303-d467-4146-9f81-c1c27d6340cf tempest-TestStampPattern-1708731291 None] Created reservations ['367c1811-79f9-4bd3-ba57-f005487407fd', 'eaded2d6-72ad-4061-8d41-d21024b6362f', 'c83d1367-6f1c-4cd6-be7d-b4a3c4cd6160', '1b867b83-c11b-4d34-afbc-18d348ae8398'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:49:55 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-767ff303-d467-4146-9f81-c1c27d6340cf tempest-TestStampPattern-1708731291 None] Delete snapshot completed successfully.
Nov 07 02:49:55 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-767ff303-d467-4146-9f81-c1c27d6340cf tempest-TestStampPattern-1708731291 None] Lock "cinder-189c1ec3-c4d7-437b-8321-4f2c1f4ea91e-delete_snapshot" released by "delete_snapshot" :: held 1.704s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-591015d2-8ab1-4884-9b40-7ad3a406913e tempest-TestStampPattern-1708731291 None] Acquiring lock "cinder-46c733d7-dbcf-4f5d-a541-92e03f9e05cd-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-591015d2-8ab1-4884-9b40-7ad3a406913e tempest-TestStampPattern-1708731291 None] Lock "cinder-46c733d7-dbcf-4f5d-a541-92e03f9e05cd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:49:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:49:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:49:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:49:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:49:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:49:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:59 devstack sudo[106609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:49:59 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-591015d2-8ab1-4884-9b40-7ad3a406913e tempest-TestStampPattern-1708731291 None] Acquiring lock "cinder-quobyte-46c733d7-dbcf-4f5d-a541-92e03f9e05cd" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:49:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-591015d2-8ab1-4884-9b40-7ad3a406913e tempest-TestStampPattern-1708731291 None] Lock "cinder-quobyte-46c733d7-dbcf-4f5d-a541-92e03f9e05cd" acquired by "delete_volume" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:49:59 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4a1834-b4ce-4eef-bbbb-b4052ebf9c70]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:49:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-591015d2-8ab1-4884-9b40-7ad3a406913e tempest-TestStampPattern-1708731291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:59 devstack sudo[106611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd
Nov 07 02:49:59 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:59 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.252s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:49:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:49:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 28 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:49:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>, <Thread(fd_logger, started daemon 125443282798592)>, <Thread(privsep_reader, started daemon 125443284556288)>, <Thread(tpool_thread_0, started daemon 125443276445376)>, <Thread(tpool_thread_1, started daemon 125443268036288)>, <Thread(tpool_thread_2, started daemon 125443259627200)>, <Thread(tpool_thread_3, started daemon 125443251218112)>, <Thread(tpool_thread_4, started daemon 125443242809024)>, <Thread(tpool_thread_5, started daemon 125443234399936)>, <Thread(tpool_thread_6, started daemon 125443225990848)>, <Thread(tpool_thread_7, started daemon 125443217581760)>, <Thread(tpool_thread_8, started daemon 125443209172672)>, <Thread(tpool_thread_9, started daemon 125443200763584)>, <Thread(tpool_thread_10, started daemon 125443192354496)>, <Thread(tpool_thread_11, started daemon 125443183945408)>, <Thread(tpool_thread_12, started daemon 125443175536320)>, <Thread(tpool_thread_13, started daemon 125443167127232)>, <Thread(tpool_thread_14, started daemon 125443158718144)>, <Thread(tpool_thread_15, started daemon 125443150309056)>, <Thread(tpool_thread_16, started daemon 125443141899968)>, <Thread(tpool_thread_17, started daemon 125443133490880)>, <Thread(tpool_thread_18, started daemon 125443125081792)>, <Thread(tpool_thread_19, started daemon 125443116672704)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:49:59 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-591015d2-8ab1-4884-9b40-7ad3a406913e tempest-TestStampPattern-1708731291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd" returned: 0 in 0.352s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-591015d2-8ab1-4884-9b40-7ad3a406913e tempest-TestStampPattern-1708731291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:49:59 devstack sudo[106617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd
Nov 07 02:49:59 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:49:59 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root
Nov 07 02:49:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-591015d2-8ab1-4884-9b40-7ad3a406913e tempest-TestStampPattern-1708731291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-46c733d7-dbcf-4f5d-a541-92e03f9e05cd" returned: 0 in 0.231s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:49:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-591015d2-8ab1-4884-9b40-7ad3a406913e tempest-TestStampPattern-1708731291 None] Lock "cinder-quobyte-46c733d7-dbcf-4f5d-a541-92e03f9e05cd" released by "delete_volume" :: held 0.655s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:49:59 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-591015d2-8ab1-4884-9b40-7ad3a406913e tempest-TestStampPattern-1708731291 None] Created reservations ['67882796-4448-4104-ba68-bf8112f17a21', '8970da32-8aa2-4ea1-9e50-b9b5baeba604', 'a6101616-0db5-4ea5-8020-07b08ee2a0f1', '255f3d4b-fdb8-49fb-9c37-e5dc236ab1b8'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:50:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-591015d2-8ab1-4884-9b40-7ad3a406913e tempest-TestStampPattern-1708731291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-591015d2-8ab1-4884-9b40-7ad3a406913e tempest-TestStampPattern-1708731291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:00 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-591015d2-8ab1-4884-9b40-7ad3a406913e tempest-TestStampPattern-1708731291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:00 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-591015d2-8ab1-4884-9b40-7ad3a406913e tempest-TestStampPattern-1708731291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-591015d2-8ab1-4884-9b40-7ad3a406913e tempest-TestStampPattern-1708731291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-591015d2-8ab1-4884-9b40-7ad3a406913e tempest-TestStampPattern-1708731291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:00 devstack sudo[106620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:50:00 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:00 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-591015d2-8ab1-4884-9b40-7ad3a406913e tempest-TestStampPattern-1708731291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.248s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:00 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-591015d2-8ab1-4884-9b40-7ad3a406913e tempest-TestStampPattern-1708731291 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:50:00 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-591015d2-8ab1-4884-9b40-7ad3a406913e tempest-TestStampPattern-1708731291 None] Deleted volume successfully.
Nov 07 02:50:00 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-591015d2-8ab1-4884-9b40-7ad3a406913e tempest-TestStampPattern-1708731291 None] Lock "cinder-46c733d7-dbcf-4f5d-a541-92e03f9e05cd-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:10 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=20,cinder:INSERT=9,cinder:UPDATE=24 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:50:10 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:UPDATE=23,cinder:SELECT=27,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Flow 'volume_create_manager' (8738c5b6-1ac9-4488-84f4-e1ed9b2d80d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1562ea12-9a07-4aed-819b-a40793bafa5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1562ea12-9a07-4aed-819b-a40793bafa5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-634139715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4590b3dc-9c92-4438-b73a-6991fdbeaeb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72046cf83d004e14874b311ae2a851db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:50:11Z,use_quota=True,user_id='461dfa11bcd04ab2b6ead917b8a2ac74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ae7114-a799-4ede-a6fd-587c1c62da7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ae7114-a799-4ede-a6fd-587c1c62da7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac96a3a-d1da-4383-87ad-3ba3561fe67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac96a3a-d1da-4383-87ad-3ba3561fe67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4590b3dc-9c92-4438-b73a-6991fdbeaeb1', 'volume_name': 'volume-4590b3dc-9c92-4438-b73a-6991fdbeaeb1', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5be43b9-0d62-4e4e-ac6d-43e00321e90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5be43b9-0d62-4e4e-ac6d-43e00321e90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc9f7ea-1d01-4acd-910a-486338654035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:11 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Volume 4590b3dc-9c92-4438-b73a-6991fdbeaeb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4590b3dc-9c92-4438-b73a-6991fdbeaeb1', 'volume_size': 1}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-634139715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4590b3dc-9c92-4438-b73a-6991fdbeaeb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72046cf83d004e14874b311ae2a851db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:50:11Z,use_quota=True,user_id='461dfa11bcd04ab2b6ead917b8a2ac74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Creating volume 4590b3dc-9c92-4438-b73a-6991fdbeaeb1 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:50:11 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4590b3dc-9c92-4438-b73a-6991fdbeaeb1 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:11 devstack sudo[106669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4590b3dc-9c92-4438-b73a-6991fdbeaeb1 1073741824
Nov 07 02:50:11 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Flow 'volume_create_manager' (e6212089-a7bd-49c8-a46d-a790093afdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6c53cf-6b87-4d0e-807b-83a66402d0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6c53cf-6b87-4d0e-807b-83a66402d0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-169385374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1032f0-6f44-4032-a199-9abe73933169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72046cf83d004e14874b311ae2a851db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:50:12Z,use_quota=True,user_id='461dfa11bcd04ab2b6ead917b8a2ac74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160f1a22-df33-435c-a28e-91c7bb5393b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160f1a22-df33-435c-a28e-91c7bb5393b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf4f1b4-712f-4489-8dc7-4a3f5adbdc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf4f1b4-712f-4489-8dc7-4a3f5adbdc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc1032f0-6f44-4032-a199-9abe73933169', 'volume_name': 'volume-dc1032f0-6f44-4032-a199-9abe73933169', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01c2861-bb53-40e2-8aa0-19da7b0c5fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01c2861-bb53-40e2-8aa0-19da7b0c5fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d2110b-9a86-4e8c-82d3-f2e387ba143b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:11 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Volume dc1032f0-6f44-4032-a199-9abe73933169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc1032f0-6f44-4032-a199-9abe73933169', 'volume_size': 1}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:11 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4590b3dc-9c92-4438-b73a-6991fdbeaeb1 1073741824" returned: 0 in 0.505s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4590b3dc-9c92-4438-b73a-6991fdbeaeb1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:11 devstack sudo[106675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4590b3dc-9c92-4438-b73a-6991fdbeaeb1
Nov 07 02:50:11 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Flow 'volume_create_manager' (78adc7d9-f1dc-48ad-a4d7-7d7d75cfc5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dadbfab-ada5-4436-ade3-1e9b4ae698a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dadbfab-ada5-4436-ade3-1e9b4ae698a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1639239950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5345079-b8e5-4a20-8c16-b5b9443da101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72046cf83d004e14874b311ae2a851db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:50:12Z,use_quota=True,user_id='461dfa11bcd04ab2b6ead917b8a2ac74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bceb69-8ed2-4727-9f28-6727e9d6022f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bceb69-8ed2-4727-9f28-6727e9d6022f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eff700b-375e-4d58-9358-ca38fdb1e54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eff700b-375e-4d58-9358-ca38fdb1e54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5345079-b8e5-4a20-8c16-b5b9443da101', 'volume_name': 'volume-b5345079-b8e5-4a20-8c16-b5b9443da101', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9902a92-533a-4459-bb94-a436f4e60a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9902a92-533a-4459-bb94-a436f4e60a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4064465-cbf4-4fd5-be6a-6c4f6d1296ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:12 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Volume b5345079-b8e5-4a20-8c16-b5b9443da101: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5345079-b8e5-4a20-8c16-b5b9443da101', 'volume_size': 1}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:12 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4590b3dc-9c92-4438-b73a-6991fdbeaeb1" returned: 0 in 0.335s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.529s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-169385374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1032f0-6f44-4032-a199-9abe73933169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72046cf83d004e14874b311ae2a851db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:50:12Z,use_quota=True,user_id='461dfa11bcd04ab2b6ead917b8a2ac74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Creating volume dc1032f0-6f44-4032-a199-9abe73933169 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:50:12 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dc1032f0-6f44-4032-a199-9abe73933169 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc9f7ea-1d01-4acd-910a-486338654035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4590b3dc-9c92-4438-b73a-6991fdbeaeb1', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156487ec-8afa-4557-9ca0-a378f4fcdc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:12 devstack sudo[106678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dc1032f0-6f44-4032-a199-9abe73933169 1073741824
Nov 07 02:50:12 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:12 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Volume volume-4590b3dc-9c92-4438-b73a-6991fdbeaeb1 (4590b3dc-9c92-4438-b73a-6991fdbeaeb1): created successfully
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156487ec-8afa-4557-9ca0-a378f4fcdc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Flow 'volume_create_manager' (8738c5b6-1ac9-4488-84f4-e1ed9b2d80d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Flow 'volume_create_manager' (3b082ff4-8884-4817-9be8-1353fe589912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b6ed8a-4159-4f99-b19f-1639b97386e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b6ed8a-4159-4f99-b19f-1639b97386e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1418916532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694445aa-ff4e-4203-9b8f-20da684d7d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72046cf83d004e14874b311ae2a851db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:50:12Z,use_quota=True,user_id='461dfa11bcd04ab2b6ead917b8a2ac74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c96db16d-7b82-42ce-b279-847340797a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c96db16d-7b82-42ce-b279-847340797a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78bdbec8-69f8-43c8-8e79-e89ab73a7ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78bdbec8-69f8-43c8-8e79-e89ab73a7ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '694445aa-ff4e-4203-9b8f-20da684d7d78', 'volume_name': 'volume-694445aa-ff4e-4203-9b8f-20da684d7d78', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5645be-eb0f-4332-835f-9f905542b09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5645be-eb0f-4332-835f-9f905542b09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3779dba-35fd-4a50-ad97-f5b69c871737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:12 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Volume 694445aa-ff4e-4203-9b8f-20da684d7d78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-694445aa-ff4e-4203-9b8f-20da684d7d78', 'volume_size': 1}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:12 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f90b4aee-d0f7-4287-b2ba-6e671749735b tempest-CreateVolumesFromImageTest-667150121 None] Created volume successfully.
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Flow 'volume_create_manager' (82cb5f02-8a07-4a6e-bd92-2d7bdf144a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (232648b2-0528-4a8b-8bc4-a106c4044d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (232648b2-0528-4a8b-8bc4-a106c4044d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1475260245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba76f858-7879-4296-8af5-bf703ca8c0c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72046cf83d004e14874b311ae2a851db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:50:13Z,use_quota=True,user_id='461dfa11bcd04ab2b6ead917b8a2ac74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3587e655-0c90-4a41-af81-5f8c80a8d3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:12 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3587e655-0c90-4a41-af81-5f8c80a8d3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d2b3ea-e062-4d2e-ba05-7897d9bf37ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d2b3ea-e062-4d2e-ba05-7897d9bf37ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba76f858-7879-4296-8af5-bf703ca8c0c1', 'volume_name': 'volume-ba76f858-7879-4296-8af5-bf703ca8c0c1', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98314cc2-80dd-4df0-a165-dd52a58854ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98314cc2-80dd-4df0-a165-dd52a58854ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28568da5-858c-4a8b-b7c7-6d6f33b4772a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:12 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Volume ba76f858-7879-4296-8af5-bf703ca8c0c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba76f858-7879-4296-8af5-bf703ca8c0c1', 'volume_size': 1}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dc1032f0-6f44-4032-a199-9abe73933169 1073741824" returned: 0 in 0.529s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dc1032f0-6f44-4032-a199-9abe73933169 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:12 devstack sudo[106684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dc1032f0-6f44-4032-a199-9abe73933169
Nov 07 02:50:12 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:13 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dc1032f0-6f44-4032-a199-9abe73933169" returned: 0 in 0.236s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.995s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1639239950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5345079-b8e5-4a20-8c16-b5b9443da101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72046cf83d004e14874b311ae2a851db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:50:12Z,use_quota=True,user_id='461dfa11bcd04ab2b6ead917b8a2ac74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Creating volume b5345079-b8e5-4a20-8c16-b5b9443da101 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:50:13 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b5345079-b8e5-4a20-8c16-b5b9443da101 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d2110b-9a86-4e8c-82d3-f2e387ba143b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc1032f0-6f44-4032-a199-9abe73933169', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:13 devstack sudo[106687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b5345079-b8e5-4a20-8c16-b5b9443da101 1073741824
Nov 07 02:50:13 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8976869e-1471-4460-9e67-28e596774068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:13 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Volume volume-dc1032f0-6f44-4032-a199-9abe73933169 (dc1032f0-6f44-4032-a199-9abe73933169): created successfully
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8976869e-1471-4460-9e67-28e596774068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Flow 'volume_create_manager' (e6212089-a7bd-49c8-a46d-a790093afdf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:50:13 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-21171494-3679-49de-9caa-47bf1b218139 tempest-CreateVolumesFromImageTest-667150121 None] Created volume successfully.
Nov 07 02:50:13 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b5345079-b8e5-4a20-8c16-b5b9443da101 1073741824" returned: 0 in 0.394s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b5345079-b8e5-4a20-8c16-b5b9443da101 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:13 devstack sudo[106693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b5345079-b8e5-4a20-8c16-b5b9443da101
Nov 07 02:50:13 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:13 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b5345079-b8e5-4a20-8c16-b5b9443da101" returned: 0 in 0.255s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.340s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1418916532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694445aa-ff4e-4203-9b8f-20da684d7d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72046cf83d004e14874b311ae2a851db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:50:12Z,use_quota=True,user_id='461dfa11bcd04ab2b6ead917b8a2ac74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Creating volume 694445aa-ff4e-4203-9b8f-20da684d7d78 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:50:13 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-694445aa-ff4e-4203-9b8f-20da684d7d78 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4064465-cbf4-4fd5-be6a-6c4f6d1296ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5345079-b8e5-4a20-8c16-b5b9443da101', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:13 devstack sudo[106696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-694445aa-ff4e-4203-9b8f-20da684d7d78 1073741824
Nov 07 02:50:13 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96880c4c-df42-46d9-83b6-bdd9627d720c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:13 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Volume volume-b5345079-b8e5-4a20-8c16-b5b9443da101 (b5345079-b8e5-4a20-8c16-b5b9443da101): created successfully
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96880c4c-df42-46d9-83b6-bdd9627d720c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Flow 'volume_create_manager' (78adc7d9-f1dc-48ad-a4d7-7d7d75cfc5db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:50:13 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-d0c64932-2e38-4c19-811f-f2636bc13fb2 tempest-CreateVolumesFromImageTest-667150121 None] Created volume successfully.
Nov 07 02:50:14 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-694445aa-ff4e-4203-9b8f-20da684d7d78 1073741824" returned: 0 in 0.411s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-694445aa-ff4e-4203-9b8f-20da684d7d78 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:14 devstack sudo[106701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-694445aa-ff4e-4203-9b8f-20da684d7d78
Nov 07 02:50:14 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:14 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-694445aa-ff4e-4203-9b8f-20da684d7d78" returned: 0 in 0.251s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:50:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.702s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1475260245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba76f858-7879-4296-8af5-bf703ca8c0c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72046cf83d004e14874b311ae2a851db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:50:13Z,use_quota=True,user_id='461dfa11bcd04ab2b6ead917b8a2ac74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:50:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Creating volume ba76f858-7879-4296-8af5-bf703ca8c0c1 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:50:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:50:14 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:50:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba76f858-7879-4296-8af5-bf703ca8c0c1 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:14 devstack sudo[106704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba76f858-7879-4296-8af5-bf703ca8c0c1 1073741824
Nov 07 02:50:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3779dba-35fd-4a50-ad97-f5b69c871737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-694445aa-ff4e-4203-9b8f-20da684d7d78', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:14 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c58a2bf3-a183-4f05-8263-e6c47c511d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:14 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Volume volume-694445aa-ff4e-4203-9b8f-20da684d7d78 (694445aa-ff4e-4203-9b8f-20da684d7d78): created successfully
Nov 07 02:50:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c58a2bf3-a183-4f05-8263-e6c47c511d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Flow 'volume_create_manager' (3b082ff4-8884-4817-9be8-1353fe589912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:50:14 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-dbe4eedc-9d0d-4119-b698-329be795b2f9 tempest-CreateVolumesFromImageTest-667150121 None] Created volume successfully.
Nov 07 02:50:14 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba76f858-7879-4296-8af5-bf703ca8c0c1 1073741824" returned: 0 in 0.454s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba76f858-7879-4296-8af5-bf703ca8c0c1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:15 devstack sudo[106717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba76f858-7879-4296-8af5-bf703ca8c0c1
Nov 07 02:50:15 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:15 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba76f858-7879-4296-8af5-bf703ca8c0c1" returned: 0 in 0.234s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:50:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28568da5-858c-4a8b-b7c7-6d6f33b4772a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba76f858-7879-4296-8af5-bf703ca8c0c1', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63e7bf2-1c24-448a-8d9f-39901a23c5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:15 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Volume volume-ba76f858-7879-4296-8af5-bf703ca8c0c1 (ba76f858-7879-4296-8af5-bf703ca8c0c1): created successfully
Nov 07 02:50:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63e7bf2-1c24-448a-8d9f-39901a23c5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Flow 'volume_create_manager' (82cb5f02-8a07-4a6e-bd92-2d7bdf144a7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:50:15 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-140e8152-a655-4fc7-8978-9c84025b20ab tempest-CreateVolumesFromImageTest-667150121 None] Created volume successfully.
Nov 07 02:50:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ac2810b1-650e-448f-8038-ca902dad07fa tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "cinder-ba76f858-7879-4296-8af5-bf703ca8c0c1-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ac2810b1-650e-448f-8038-ca902dad07fa tempest-CreateVolumesFromImageTest-667150121 None] Lock "cinder-ba76f858-7879-4296-8af5-bf703ca8c0c1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ac2810b1-650e-448f-8038-ca902dad07fa tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "cinder-quobyte-ba76f858-7879-4296-8af5-bf703ca8c0c1" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ac2810b1-650e-448f-8038-ca902dad07fa tempest-CreateVolumesFromImageTest-667150121 None] Lock "cinder-quobyte-ba76f858-7879-4296-8af5-bf703ca8c0c1" acquired by "delete_volume" :: waited 0.014s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:16 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62f32d2-791f-46c7-a19e-16c15858136d]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:50:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac2810b1-650e-448f-8038-ca902dad07fa tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba76f858-7879-4296-8af5-bf703ca8c0c1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:16 devstack sudo[106720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba76f858-7879-4296-8af5-bf703ca8c0c1
Nov 07 02:50:16 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:16 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac2810b1-650e-448f-8038-ca902dad07fa tempest-CreateVolumesFromImageTest-667150121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba76f858-7879-4296-8af5-bf703ca8c0c1" returned: 0 in 0.352s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac2810b1-650e-448f-8038-ca902dad07fa tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba76f858-7879-4296-8af5-bf703ca8c0c1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:16 devstack sudo[106725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba76f858-7879-4296-8af5-bf703ca8c0c1
Nov 07 02:50:16 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:16 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac2810b1-650e-448f-8038-ca902dad07fa tempest-CreateVolumesFromImageTest-667150121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ba76f858-7879-4296-8af5-bf703ca8c0c1" returned: 0 in 0.239s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ac2810b1-650e-448f-8038-ca902dad07fa tempest-CreateVolumesFromImageTest-667150121 None] Lock "cinder-quobyte-ba76f858-7879-4296-8af5-bf703ca8c0c1" released by "delete_volume" :: held 0.633s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:16 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-ac2810b1-650e-448f-8038-ca902dad07fa tempest-CreateVolumesFromImageTest-667150121 None] Created reservations ['565df29e-08f0-43c3-9f0f-b314ea1c781c', '5c357113-b126-442f-b79e-29e50b33534b', '01f8017b-ca09-4418-92f4-ded4b9b5c2f3', 'bcc687c9-b2e7-43d7-978b-22469e22f9e2'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:50:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ac2810b1-650e-448f-8038-ca902dad07fa tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ac2810b1-650e-448f-8038-ca902dad07fa tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ac2810b1-650e-448f-8038-ca902dad07fa tempest-CreateVolumesFromImageTest-667150121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ac2810b1-650e-448f-8038-ca902dad07fa tempest-CreateVolumesFromImageTest-667150121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ac2810b1-650e-448f-8038-ca902dad07fa tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac2810b1-650e-448f-8038-ca902dad07fa tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:16 devstack sudo[106728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:50:16 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:17 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ac2810b1-650e-448f-8038-ca902dad07fa tempest-CreateVolumesFromImageTest-667150121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.241s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:17 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-ac2810b1-650e-448f-8038-ca902dad07fa tempest-CreateVolumesFromImageTest-667150121 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:50:17 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ac2810b1-650e-448f-8038-ca902dad07fa tempest-CreateVolumesFromImageTest-667150121 None] Deleted volume successfully.
Nov 07 02:50:17 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ac2810b1-650e-448f-8038-ca902dad07fa tempest-CreateVolumesFromImageTest-667150121 None] Lock "cinder-ba76f858-7879-4296-8af5-bf703ca8c0c1-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:17 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a704216a-7846-4a87-b17e-923db16c0c4b tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "cinder-694445aa-ff4e-4203-9b8f-20da684d7d78-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:17 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a704216a-7846-4a87-b17e-923db16c0c4b tempest-CreateVolumesFromImageTest-667150121 None] Lock "cinder-694445aa-ff4e-4203-9b8f-20da684d7d78-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:17 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a704216a-7846-4a87-b17e-923db16c0c4b tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "cinder-quobyte-694445aa-ff4e-4203-9b8f-20da684d7d78" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:17 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a704216a-7846-4a87-b17e-923db16c0c4b tempest-CreateVolumesFromImageTest-667150121 None] Lock "cinder-quobyte-694445aa-ff4e-4203-9b8f-20da684d7d78" acquired by "delete_volume" :: waited 0.014s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:17 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[d963a0c0-167a-408a-988b-900c653e712e]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:50:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a704216a-7846-4a87-b17e-923db16c0c4b tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-694445aa-ff4e-4203-9b8f-20da684d7d78 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:17 devstack sudo[106731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-694445aa-ff4e-4203-9b8f-20da684d7d78
Nov 07 02:50:17 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:17 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a704216a-7846-4a87-b17e-923db16c0c4b tempest-CreateVolumesFromImageTest-667150121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-694445aa-ff4e-4203-9b8f-20da684d7d78" returned: 0 in 0.349s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a704216a-7846-4a87-b17e-923db16c0c4b tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-694445aa-ff4e-4203-9b8f-20da684d7d78 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:17 devstack sudo[106736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-694445aa-ff4e-4203-9b8f-20da684d7d78
Nov 07 02:50:17 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:17 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a704216a-7846-4a87-b17e-923db16c0c4b tempest-CreateVolumesFromImageTest-667150121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-694445aa-ff4e-4203-9b8f-20da684d7d78" returned: 0 in 0.256s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:17 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a704216a-7846-4a87-b17e-923db16c0c4b tempest-CreateVolumesFromImageTest-667150121 None] Lock "cinder-quobyte-694445aa-ff4e-4203-9b8f-20da684d7d78" released by "delete_volume" :: held 0.649s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:18 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-a704216a-7846-4a87-b17e-923db16c0c4b tempest-CreateVolumesFromImageTest-667150121 None] Created reservations ['b85a3b5d-85f3-4365-a786-25d36df20435', '3041a728-7e9d-43e5-b6a2-247af52ef8b8', '062f5feb-dc37-48b3-a8c1-40f75df6ac71', '1c74a136-cfbf-4abb-a54c-423a123af297'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:50:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a704216a-7846-4a87-b17e-923db16c0c4b tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a704216a-7846-4a87-b17e-923db16c0c4b tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:18 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a704216a-7846-4a87-b17e-923db16c0c4b tempest-CreateVolumesFromImageTest-667150121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:18 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a704216a-7846-4a87-b17e-923db16c0c4b tempest-CreateVolumesFromImageTest-667150121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a704216a-7846-4a87-b17e-923db16c0c4b tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a704216a-7846-4a87-b17e-923db16c0c4b tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:18 devstack sudo[106739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:50:18 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:18 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a704216a-7846-4a87-b17e-923db16c0c4b tempest-CreateVolumesFromImageTest-667150121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.244s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:18 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-a704216a-7846-4a87-b17e-923db16c0c4b tempest-CreateVolumesFromImageTest-667150121 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:50:18 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-a704216a-7846-4a87-b17e-923db16c0c4b tempest-CreateVolumesFromImageTest-667150121 None] Deleted volume successfully.
Nov 07 02:50:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a704216a-7846-4a87-b17e-923db16c0c4b tempest-CreateVolumesFromImageTest-667150121 None] Lock "cinder-694445aa-ff4e-4203-9b8f-20da684d7d78-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-373e95b1-d81d-4d6a-90c5-bc92e443e712 tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "cinder-b5345079-b8e5-4a20-8c16-b5b9443da101-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-373e95b1-d81d-4d6a-90c5-bc92e443e712 tempest-CreateVolumesFromImageTest-667150121 None] Lock "cinder-b5345079-b8e5-4a20-8c16-b5b9443da101-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-373e95b1-d81d-4d6a-90c5-bc92e443e712 tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "cinder-quobyte-b5345079-b8e5-4a20-8c16-b5b9443da101" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-373e95b1-d81d-4d6a-90c5-bc92e443e712 tempest-CreateVolumesFromImageTest-667150121 None] Lock "cinder-quobyte-b5345079-b8e5-4a20-8c16-b5b9443da101" acquired by "delete_volume" :: waited 0.014s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:18 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a76c6d-9639-44d7-9bbf-12afc2304cf9]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:50:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-373e95b1-d81d-4d6a-90c5-bc92e443e712 tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b5345079-b8e5-4a20-8c16-b5b9443da101 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:18 devstack sudo[106743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b5345079-b8e5-4a20-8c16-b5b9443da101
Nov 07 02:50:18 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:18 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-373e95b1-d81d-4d6a-90c5-bc92e443e712 tempest-CreateVolumesFromImageTest-667150121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b5345079-b8e5-4a20-8c16-b5b9443da101" returned: 0 in 0.344s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-373e95b1-d81d-4d6a-90c5-bc92e443e712 tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b5345079-b8e5-4a20-8c16-b5b9443da101 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:18 devstack sudo[106748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b5345079-b8e5-4a20-8c16-b5b9443da101
Nov 07 02:50:18 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:19 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-373e95b1-d81d-4d6a-90c5-bc92e443e712 tempest-CreateVolumesFromImageTest-667150121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b5345079-b8e5-4a20-8c16-b5b9443da101" returned: 0 in 0.245s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-373e95b1-d81d-4d6a-90c5-bc92e443e712 tempest-CreateVolumesFromImageTest-667150121 None] Lock "cinder-quobyte-b5345079-b8e5-4a20-8c16-b5b9443da101" released by "delete_volume" :: held 0.631s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:19 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-373e95b1-d81d-4d6a-90c5-bc92e443e712 tempest-CreateVolumesFromImageTest-667150121 None] Created reservations ['5425d287-332d-4af1-a486-9287d51fd11a', 'd3f05560-777e-4720-84d8-40e6a8a615d0', 'd104bb64-7188-4b99-8065-7b542732b1fd', 'f19a6bc4-2662-458a-96d9-8864dcd572e7'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:50:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-373e95b1-d81d-4d6a-90c5-bc92e443e712 tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-373e95b1-d81d-4d6a-90c5-bc92e443e712 tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-373e95b1-d81d-4d6a-90c5-bc92e443e712 tempest-CreateVolumesFromImageTest-667150121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-373e95b1-d81d-4d6a-90c5-bc92e443e712 tempest-CreateVolumesFromImageTest-667150121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-373e95b1-d81d-4d6a-90c5-bc92e443e712 tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-373e95b1-d81d-4d6a-90c5-bc92e443e712 tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:19 devstack sudo[106751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:50:19 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:19 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-373e95b1-d81d-4d6a-90c5-bc92e443e712 tempest-CreateVolumesFromImageTest-667150121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.253s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:19 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-373e95b1-d81d-4d6a-90c5-bc92e443e712 tempest-CreateVolumesFromImageTest-667150121 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:50:19 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-373e95b1-d81d-4d6a-90c5-bc92e443e712 tempest-CreateVolumesFromImageTest-667150121 None] Deleted volume successfully.
Nov 07 02:50:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-373e95b1-d81d-4d6a-90c5-bc92e443e712 tempest-CreateVolumesFromImageTest-667150121 None] Lock "cinder-b5345079-b8e5-4a20-8c16-b5b9443da101-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-074eae7c-3dee-4bcd-9cdd-fff6400939b5 tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "cinder-dc1032f0-6f44-4032-a199-9abe73933169-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-074eae7c-3dee-4bcd-9cdd-fff6400939b5 tempest-CreateVolumesFromImageTest-667150121 None] Lock "cinder-dc1032f0-6f44-4032-a199-9abe73933169-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-074eae7c-3dee-4bcd-9cdd-fff6400939b5 tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "cinder-quobyte-dc1032f0-6f44-4032-a199-9abe73933169" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-074eae7c-3dee-4bcd-9cdd-fff6400939b5 tempest-CreateVolumesFromImageTest-667150121 None] Lock "cinder-quobyte-dc1032f0-6f44-4032-a199-9abe73933169" acquired by "delete_volume" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:19 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[63431f20-2641-4c31-adc1-0affbb3f014f]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:50:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-074eae7c-3dee-4bcd-9cdd-fff6400939b5 tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dc1032f0-6f44-4032-a199-9abe73933169 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:19 devstack sudo[106754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dc1032f0-6f44-4032-a199-9abe73933169
Nov 07 02:50:19 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:19 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-074eae7c-3dee-4bcd-9cdd-fff6400939b5 tempest-CreateVolumesFromImageTest-667150121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dc1032f0-6f44-4032-a199-9abe73933169" returned: 0 in 0.343s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-074eae7c-3dee-4bcd-9cdd-fff6400939b5 tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dc1032f0-6f44-4032-a199-9abe73933169 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:19 devstack sudo[106759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dc1032f0-6f44-4032-a199-9abe73933169
Nov 07 02:50:19 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:20 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-074eae7c-3dee-4bcd-9cdd-fff6400939b5 tempest-CreateVolumesFromImageTest-667150121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-dc1032f0-6f44-4032-a199-9abe73933169" returned: 0 in 0.242s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-074eae7c-3dee-4bcd-9cdd-fff6400939b5 tempest-CreateVolumesFromImageTest-667150121 None] Lock "cinder-quobyte-dc1032f0-6f44-4032-a199-9abe73933169" released by "delete_volume" :: held 0.626s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:20 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-074eae7c-3dee-4bcd-9cdd-fff6400939b5 tempest-CreateVolumesFromImageTest-667150121 None] Created reservations ['542d2615-a672-432d-ba16-3182e7ee050a', '69d5990b-bd49-4118-bfb4-8720d599f2fe', '8159d929-d775-4796-ab33-c84798d76eee', 'c3c3aea5-e7f4-448d-be16-a62ad171d71d'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:50:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-074eae7c-3dee-4bcd-9cdd-fff6400939b5 tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-074eae7c-3dee-4bcd-9cdd-fff6400939b5 tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-074eae7c-3dee-4bcd-9cdd-fff6400939b5 tempest-CreateVolumesFromImageTest-667150121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-074eae7c-3dee-4bcd-9cdd-fff6400939b5 tempest-CreateVolumesFromImageTest-667150121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-074eae7c-3dee-4bcd-9cdd-fff6400939b5 tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-074eae7c-3dee-4bcd-9cdd-fff6400939b5 tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:20 devstack sudo[106762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:50:20 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:20 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-074eae7c-3dee-4bcd-9cdd-fff6400939b5 tempest-CreateVolumesFromImageTest-667150121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.236s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:20 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-074eae7c-3dee-4bcd-9cdd-fff6400939b5 tempest-CreateVolumesFromImageTest-667150121 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:50:20 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-074eae7c-3dee-4bcd-9cdd-fff6400939b5 tempest-CreateVolumesFromImageTest-667150121 None] Deleted volume successfully.
Nov 07 02:50:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-074eae7c-3dee-4bcd-9cdd-fff6400939b5 tempest-CreateVolumesFromImageTest-667150121 None] Lock "cinder-dc1032f0-6f44-4032-a199-9abe73933169-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b06380ee-01a6-4975-a1f6-4ff0c1f5af41 tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "cinder-4590b3dc-9c92-4438-b73a-6991fdbeaeb1-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b06380ee-01a6-4975-a1f6-4ff0c1f5af41 tempest-CreateVolumesFromImageTest-667150121 None] Lock "cinder-4590b3dc-9c92-4438-b73a-6991fdbeaeb1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b06380ee-01a6-4975-a1f6-4ff0c1f5af41 tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "cinder-quobyte-4590b3dc-9c92-4438-b73a-6991fdbeaeb1" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b06380ee-01a6-4975-a1f6-4ff0c1f5af41 tempest-CreateVolumesFromImageTest-667150121 None] Lock "cinder-quobyte-4590b3dc-9c92-4438-b73a-6991fdbeaeb1" acquired by "delete_volume" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:20 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[1100c277-9207-4969-9bc2-6c4d1e42bb8c]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:50:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b06380ee-01a6-4975-a1f6-4ff0c1f5af41 tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4590b3dc-9c92-4438-b73a-6991fdbeaeb1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:20 devstack sudo[106765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4590b3dc-9c92-4438-b73a-6991fdbeaeb1
Nov 07 02:50:20 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:21 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b06380ee-01a6-4975-a1f6-4ff0c1f5af41 tempest-CreateVolumesFromImageTest-667150121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4590b3dc-9c92-4438-b73a-6991fdbeaeb1" returned: 0 in 0.347s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b06380ee-01a6-4975-a1f6-4ff0c1f5af41 tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4590b3dc-9c92-4438-b73a-6991fdbeaeb1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:21 devstack sudo[106770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4590b3dc-9c92-4438-b73a-6991fdbeaeb1
Nov 07 02:50:21 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:21 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b06380ee-01a6-4975-a1f6-4ff0c1f5af41 tempest-CreateVolumesFromImageTest-667150121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-4590b3dc-9c92-4438-b73a-6991fdbeaeb1" returned: 0 in 0.243s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b06380ee-01a6-4975-a1f6-4ff0c1f5af41 tempest-CreateVolumesFromImageTest-667150121 None] Lock "cinder-quobyte-4590b3dc-9c92-4438-b73a-6991fdbeaeb1" released by "delete_volume" :: held 0.628s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:21 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-b06380ee-01a6-4975-a1f6-4ff0c1f5af41 tempest-CreateVolumesFromImageTest-667150121 None] Created reservations ['b268ccfd-ea51-4d3e-89de-4838a2000e76', 'a505e5ac-b6db-4b58-9227-a4e3f082ab01', '462a59f8-f631-4ea2-9a30-599c9204c711', 'b941b435-39f2-4402-8972-275ecb01d83f'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:50:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b06380ee-01a6-4975-a1f6-4ff0c1f5af41 tempest-CreateVolumesFromImageTest-667150121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b06380ee-01a6-4975-a1f6-4ff0c1f5af41 tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:21 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b06380ee-01a6-4975-a1f6-4ff0c1f5af41 tempest-CreateVolumesFromImageTest-667150121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:21 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b06380ee-01a6-4975-a1f6-4ff0c1f5af41 tempest-CreateVolumesFromImageTest-667150121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b06380ee-01a6-4975-a1f6-4ff0c1f5af41 tempest-CreateVolumesFromImageTest-667150121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b06380ee-01a6-4975-a1f6-4ff0c1f5af41 tempest-CreateVolumesFromImageTest-667150121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:21 devstack sudo[106773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:50:21 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:21 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b06380ee-01a6-4975-a1f6-4ff0c1f5af41 tempest-CreateVolumesFromImageTest-667150121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.244s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:21 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-b06380ee-01a6-4975-a1f6-4ff0c1f5af41 tempest-CreateVolumesFromImageTest-667150121 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:50:21 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b06380ee-01a6-4975-a1f6-4ff0c1f5af41 tempest-CreateVolumesFromImageTest-667150121 None] Deleted volume successfully.
Nov 07 02:50:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b06380ee-01a6-4975-a1f6-4ff0c1f5af41 tempest-CreateVolumesFromImageTest-667150121 None] Lock "cinder-4590b3dc-9c92-4438-b73a-6991fdbeaeb1-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Flow 'volume_create_manager' (3aa9143d-9854-49f2-b10f-a2a69ed17062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89cbff06-715c-4301-8082-0824a749c5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89cbff06-715c-4301-8082-0824a749c5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2125573303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=911242a5-fb91-4895-ad31-576aeee96ffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6da8644009b48e983e5064b4b487874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:50:24Z,use_quota=True,user_id='b3b5f3e42d5a48f38310efd886a95a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d3ff0f-48b8-4db8-97cb-8026bb1e698c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d3ff0f-48b8-4db8-97cb-8026bb1e698c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0e65037-0a09-4f63-992b-c68aee23b597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0e65037-0a09-4f63-992b-c68aee23b597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '911242a5-fb91-4895-ad31-576aeee96ffe', 'volume_name': 'volume-911242a5-fb91-4895-ad31-576aeee96ffe', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c808a9-0bd4-4e67-ad18-92b3ea7c140f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c808a9-0bd4-4e67-ad18-92b3ea7c140f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf8fe07-3d07-484c-bbfc-066fc887f682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:24 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Volume 911242a5-fb91-4895-ad31-576aeee96ffe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-911242a5-fb91-4895-ad31-576aeee96ffe', 'volume_size': 1}
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2125573303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=911242a5-fb91-4895-ad31-576aeee96ffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6da8644009b48e983e5064b4b487874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:50:24Z,use_quota=True,user_id='b3b5f3e42d5a48f38310efd886a95a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Creating volume 911242a5-fb91-4895-ad31-576aeee96ffe {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:50:24 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:24 devstack sudo[106776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe 1073741824
Nov 07 02:50:24 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:24 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe 1073741824" returned: 0 in 0.390s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:24 devstack sudo[106781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe
Nov 07 02:50:24 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:25 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe" returned: 0 in 0.240s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:50:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf8fe07-3d07-484c-bbfc-066fc887f682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-911242a5-fb91-4895-ad31-576aeee96ffe', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870261e2-2a3c-49ed-a4e7-2131c2d41619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:25 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Volume volume-911242a5-fb91-4895-ad31-576aeee96ffe (911242a5-fb91-4895-ad31-576aeee96ffe): created successfully
Nov 07 02:50:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870261e2-2a3c-49ed-a4e7-2131c2d41619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Flow 'volume_create_manager' (3aa9143d-9854-49f2-b10f-a2a69ed17062) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:50:25 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-7b2d29e1-55f7-4e71-b86e-ee5951916d1c tempest-VolumeDependencyTests-802630225 None] Created volume successfully.
Nov 07 02:50:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0e42b235-67b1-4571-ba15-57623534cc3b tempest-VolumeDependencyTests-802630225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0e42b235-67b1-4571-ba15-57623534cc3b tempest-VolumeDependencyTests-802630225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-0e42b235-67b1-4571-ba15-57623534cc3b tempest-VolumeDependencyTests-802630225 None] Creating offline snapshot e576a469-e033-4825-8d2f-f38309a9a01f of volume 911242a5-fb91-4895-ad31-576aeee96ffe {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:50:25 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbab1050-339e-4bd6-bd2d-81b51a5e349b]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:50:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0e42b235-67b1-4571-ba15-57623534cc3b tempest-VolumeDependencyTests-802630225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:25 devstack sudo[106784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe
Nov 07 02:50:25 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:25 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0e42b235-67b1-4571-ba15-57623534cc3b tempest-VolumeDependencyTests-802630225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe" returned: 0 in 0.345s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0e42b235-67b1-4571-ba15-57623534cc3b tempest-VolumeDependencyTests-802630225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.e576a469-e033-4825-8d2f-f38309a9a01f 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:25 devstack sudo[106789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.e576a469-e033-4825-8d2f-f38309a9a01f 1G
Nov 07 02:50:25 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:26 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0e42b235-67b1-4571-ba15-57623534cc3b tempest-VolumeDependencyTests-802630225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.e576a469-e033-4825-8d2f-f38309a9a01f 1G" returned: 0 in 0.418s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0e42b235-67b1-4571-ba15-57623534cc3b tempest-VolumeDependencyTests-802630225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-911242a5-fb91-4895-ad31-576aeee96ffe -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.e576a469-e033-4825-8d2f-f38309a9a01f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:26 devstack sudo[106797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-911242a5-fb91-4895-ad31-576aeee96ffe -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.e576a469-e033-4825-8d2f-f38309a9a01f
Nov 07 02:50:26 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:26 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0e42b235-67b1-4571-ba15-57623534cc3b tempest-VolumeDependencyTests-802630225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-911242a5-fb91-4895-ad31-576aeee96ffe -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.e576a469-e033-4825-8d2f-f38309a9a01f" returned: 0 in 0.279s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:26 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-0e42b235-67b1-4571-ba15-57623534cc3b tempest-VolumeDependencyTests-802630225 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.e576a469-e033-4825-8d2f-f38309a9a01f is being set with open permissions: ugo+rw
Nov 07 02:50:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0e42b235-67b1-4571-ba15-57623534cc3b tempest-VolumeDependencyTests-802630225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.e576a469-e033-4825-8d2f-f38309a9a01f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:26 devstack sudo[106802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.e576a469-e033-4825-8d2f-f38309a9a01f
Nov 07 02:50:26 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:26 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0e42b235-67b1-4571-ba15-57623534cc3b tempest-VolumeDependencyTests-802630225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.e576a469-e033-4825-8d2f-f38309a9a01f" returned: 0 in 0.234s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0e42b235-67b1-4571-ba15-57623534cc3b tempest-VolumeDependencyTests-802630225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:26 devstack sudo[106805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.info
Nov 07 02:50:26 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:27 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0e42b235-67b1-4571-ba15-57623534cc3b tempest-VolumeDependencyTests-802630225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.info" returned: 0 in 0.244s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:27 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-0e42b235-67b1-4571-ba15-57623534cc3b tempest-VolumeDependencyTests-802630225 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.info is being set with open permissions: ugo+rw
Nov 07 02:50:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0e42b235-67b1-4571-ba15-57623534cc3b tempest-VolumeDependencyTests-802630225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:27 devstack sudo[106808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.info
Nov 07 02:50:27 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:27 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0e42b235-67b1-4571-ba15-57623534cc3b tempest-VolumeDependencyTests-802630225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.info" returned: 0 in 0.241s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0e42b235-67b1-4571-ba15-57623534cc3b tempest-VolumeDependencyTests-802630225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.845s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:27 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-0e42b235-67b1-4571-ba15-57623534cc3b tempest-VolumeDependencyTests-802630225 None] Create snapshot completed successfully
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Flow 'volume_create_manager' (b5550b46-61c5-4cf3-a2d8-7ddf4aef6037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e9599b-5858-47db-bb3d-0fda2f5e98c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e9599b-5858-47db-bb3d-0fda2f5e98c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-667188425',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e86db826-f655-4a63-9b93-8aafeddf2835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6da8644009b48e983e5064b4b487874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e576a469-e033-4825-8d2f-f38309a9a01f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:50:28Z,use_quota=True,user_id='b3b5f3e42d5a48f38310efd886a95a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e6f65f-2796-4554-a9de-9ecde2541135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e6f65f-2796-4554-a9de-9ecde2541135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eacd5aa6-1b7b-46f0-9119-0f4bb78af3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eacd5aa6-1b7b-46f0-9119-0f4bb78af3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e86db826-f655-4a63-9b93-8aafeddf2835', 'volume_name': 'volume-e86db826-f655-4a63-9b93-8aafeddf2835', 'volume_size': 1, 'snapshot_id': 'e576a469-e033-4825-8d2f-f38309a9a01f'}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5683d64b-c03c-4ad1-a52c-57bccf095181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5683d64b-c03c-4ad1-a52c-57bccf095181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a876e9-eb84-467e-80ec-7fadaa851a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:28 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Volume e86db826-f655-4a63-9b93-8aafeddf2835: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e86db826-f655-4a63-9b93-8aafeddf2835', 'volume_size': 1, 'snapshot_id': 'e576a469-e033-4825-8d2f-f38309a9a01f'}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Acquiring lock "cinder-quobyte-e576a469-e033-4825-8d2f-f38309a9a01f-e86db826-f655-4a63-9b93-8aafeddf2835" by "_create_volume_from_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Lock "cinder-quobyte-e576a469-e033-4825-8d2f-f38309a9a01f-e86db826-f655-4a63-9b93-8aafeddf2835" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Creating volume e86db826-f655-4a63-9b93-8aafeddf2835 from snapshot e576a469-e033-4825-8d2f-f38309a9a01f {{(pid=87054) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Acquiring lock "cinder-quobyte-e86db826-f655-4a63-9b93-8aafeddf2835" by "_copy_volume_from_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Lock "cinder-quobyte-e86db826-f655-4a63-9b93-8aafeddf2835" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] snapshot: e576a469-e033-4825-8d2f-f38309a9a01f, volume: e86db826-f655-4a63-9b93-8aafeddf2835,  {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64da017-d86c-4aaf-b430-2fb02a364392]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.e576a469-e033-4825-8d2f-f38309a9a01f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:28 devstack sudo[106812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.e576a469-e033-4825-8d2f-f38309a9a01f
Nov 07 02:50:28 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:28 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.e576a469-e033-4825-8d2f-f38309a9a01f" returned: 0 in 0.336s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-911242a5-fb91-4895-ad31-576aeee96ffe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4356992-1dae-4ef2-8fe2-032ffa93bd09]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:50:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:28 devstack sudo[106817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe
Nov 07 02:50:28 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:29 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe" returned: 0 in 0.335s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:50:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Creating direct copy from snapshot {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:50:29 devstack cinder-volume[87054]: DEBUG cinder.utils [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Path /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e86db826-f655-4a63-9b93-8aafeddf2835 not found in is_blk_device check {{(pid=87054) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:50:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e86db826-f655-4a63-9b93-8aafeddf2835 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:29 devstack sudo[106822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e86db826-f655-4a63-9b93-8aafeddf2835
Nov 07 02:50:29 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:34 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e86db826-f655-4a63-9b93-8aafeddf2835" returned: 0 in 5.816s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:34 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Image conversion details: src /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e86db826-f655-4a63-9b93-8aafeddf2835 {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:50:34 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Converted 1024.00 MB image at 176.03 MB/s
Nov 07 02:50:34 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e86db826-f655-4a63-9b93-8aafeddf2835 is being set with open permissions: ugo+rw
Nov 07 02:50:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e86db826-f655-4a63-9b93-8aafeddf2835 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:34 devstack sudo[106835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e86db826-f655-4a63-9b93-8aafeddf2835
Nov 07 02:50:34 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:35 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e86db826-f655-4a63-9b93-8aafeddf2835" returned: 0 in 0.239s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Lock "cinder-quobyte-e86db826-f655-4a63-9b93-8aafeddf2835" released by "_copy_volume_from_snapshot" :: held 6.802s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Lock "cinder-quobyte-e576a469-e033-4825-8d2f-f38309a9a01f-e86db826-f655-4a63-9b93-8aafeddf2835" released by "_create_volume_from_snapshot" :: held 6.865s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.880s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a876e9-eb84-467e-80ec-7fadaa851a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e86db826-f655-4a63-9b93-8aafeddf2835', 'volume_size': 1, 'snapshot_id': 'e576a469-e033-4825-8d2f-f38309a9a01f'}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7d6cad-6b4b-498e-a2a8-579b3cbe4266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:35 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Volume volume-e86db826-f655-4a63-9b93-8aafeddf2835 (e86db826-f655-4a63-9b93-8aafeddf2835): created successfully
Nov 07 02:50:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7d6cad-6b4b-498e-a2a8-579b3cbe4266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Flow 'volume_create_manager' (b5550b46-61c5-4cf3-a2d8-7ddf4aef6037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:50:35 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-8305c634-8c7e-42ca-bb2b-4760dba189c0 tempest-VolumeDependencyTests-802630225 None] Created volume successfully.
Nov 07 02:50:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-28dfe19e-7e62-4413-84a4-020764c3d245 tempest-VolumeDependencyTests-802630225 None] Acquiring lock "cinder-e576a469-e033-4825-8d2f-f38309a9a01f-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-28dfe19e-7e62-4413-84a4-020764c3d245 tempest-VolumeDependencyTests-802630225 None] Lock "cinder-e576a469-e033-4825-8d2f-f38309a9a01f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-28dfe19e-7e62-4413-84a4-020764c3d245 tempest-VolumeDependencyTests-802630225 None] Acquiring lock "cinder-quobyte-911242a5-fb91-4895-ad31-576aeee96ffe" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-28dfe19e-7e62-4413-84a4-020764c3d245 tempest-VolumeDependencyTests-802630225 None] Lock "cinder-quobyte-911242a5-fb91-4895-ad31-576aeee96ffe" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-28dfe19e-7e62-4413-84a4-020764c3d245 tempest-VolumeDependencyTests-802630225 None] Acquiring lock "cinder-quobyte-e576a469-e033-4825-8d2f-f38309a9a01f" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-28dfe19e-7e62-4413-84a4-020764c3d245 tempest-VolumeDependencyTests-802630225 None] Lock "cinder-quobyte-e576a469-e033-4825-8d2f-f38309a9a01f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-28dfe19e-7e62-4413-84a4-020764c3d245 tempest-VolumeDependencyTests-802630225 None] Deleting offline snapshot e576a469-e033-4825-8d2f-f38309a9a01f of volume 911242a5-fb91-4895-ad31-576aeee96ffe {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:50:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-28dfe19e-7e62-4413-84a4-020764c3d245 tempest-VolumeDependencyTests-802630225 None] snapshot_file for this snap is: volume-911242a5-fb91-4895-ad31-576aeee96ffe.e576a469-e033-4825-8d2f-f38309a9a01f {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:50:35 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dba5f2-fdee-40cd-8ed3-2dba057d5696]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:50:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-28dfe19e-7e62-4413-84a4-020764c3d245 tempest-VolumeDependencyTests-802630225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.e576a469-e033-4825-8d2f-f38309a9a01f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:35 devstack sudo[106838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.e576a469-e033-4825-8d2f-f38309a9a01f
Nov 07 02:50:35 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:36 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-28dfe19e-7e62-4413-84a4-020764c3d245 tempest-VolumeDependencyTests-802630225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.e576a469-e033-4825-8d2f-f38309a9a01f" returned: 0 in 0.351s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-28dfe19e-7e62-4413-84a4-020764c3d245 tempest-VolumeDependencyTests-802630225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-911242a5-fb91-4895-ad31-576aeee96ffe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:50:36 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[296bd1c8-9dd1-44b9-b7a3-17b1b1c95612]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:50:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-28dfe19e-7e62-4413-84a4-020764c3d245 tempest-VolumeDependencyTests-802630225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:36 devstack sudo[106843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe
Nov 07 02:50:36 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:36 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-28dfe19e-7e62-4413-84a4-020764c3d245 tempest-VolumeDependencyTests-802630225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe" returned: 0 in 0.527s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-28dfe19e-7e62-4413-84a4-020764c3d245 tempest-VolumeDependencyTests-802630225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.e576a469-e033-4825-8d2f-f38309a9a01f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:36 devstack sudo[106848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.e576a469-e033-4825-8d2f-f38309a9a01f
Nov 07 02:50:36 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:37 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-28dfe19e-7e62-4413-84a4-020764c3d245 tempest-VolumeDependencyTests-802630225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.e576a469-e033-4825-8d2f-f38309a9a01f" returned: 0 in 0.317s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-28dfe19e-7e62-4413-84a4-020764c3d245 tempest-VolumeDependencyTests-802630225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.e576a469-e033-4825-8d2f-f38309a9a01f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:37 devstack sudo[106853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.e576a469-e033-4825-8d2f-f38309a9a01f
Nov 07 02:50:37 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:37 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-28dfe19e-7e62-4413-84a4-020764c3d245 tempest-VolumeDependencyTests-802630225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe.e576a469-e033-4825-8d2f-f38309a9a01f" returned: 0 in 0.243s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-28dfe19e-7e62-4413-84a4-020764c3d245 tempest-VolumeDependencyTests-802630225 None] Lock "cinder-quobyte-e576a469-e033-4825-8d2f-f38309a9a01f" released by "_delete_snapshot" :: held 1.534s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-28dfe19e-7e62-4413-84a4-020764c3d245 tempest-VolumeDependencyTests-802630225 None] Lock "cinder-quobyte-911242a5-fb91-4895-ad31-576aeee96ffe" released by "delete_snapshot" :: held 1.556s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:37 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-28dfe19e-7e62-4413-84a4-020764c3d245 tempest-VolumeDependencyTests-802630225 None] Created reservations ['41b4b998-31a6-42a6-9849-f141230d623e', '81d013ec-6f5b-4a8a-a337-d900a2997c28', '4d5df9a3-aefa-454e-8e4e-b1cf208c494e', 'b9bbbd6c-77d8-49ae-995c-467ac7b3070d'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:50:37 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-28dfe19e-7e62-4413-84a4-020764c3d245 tempest-VolumeDependencyTests-802630225 None] Delete snapshot completed successfully.
Nov 07 02:50:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-28dfe19e-7e62-4413-84a4-020764c3d245 tempest-VolumeDependencyTests-802630225 None] Lock "cinder-e576a469-e033-4825-8d2f-f38309a9a01f-delete_snapshot" released by "delete_snapshot" :: held 1.679s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-414b97e8-73d9-4527-8ebb-6addc52a855d tempest-VolumeDependencyTests-802630225 None] Acquiring lock "cinder-911242a5-fb91-4895-ad31-576aeee96ffe-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-414b97e8-73d9-4527-8ebb-6addc52a855d tempest-VolumeDependencyTests-802630225 None] Lock "cinder-911242a5-fb91-4895-ad31-576aeee96ffe-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-414b97e8-73d9-4527-8ebb-6addc52a855d tempest-VolumeDependencyTests-802630225 None] Acquiring lock "cinder-quobyte-911242a5-fb91-4895-ad31-576aeee96ffe" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-414b97e8-73d9-4527-8ebb-6addc52a855d tempest-VolumeDependencyTests-802630225 None] Lock "cinder-quobyte-911242a5-fb91-4895-ad31-576aeee96ffe" acquired by "delete_volume" :: waited 0.014s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:37 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd343dbf-8d4a-4afd-b9bb-802d234d1b48]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:50:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-414b97e8-73d9-4527-8ebb-6addc52a855d tempest-VolumeDependencyTests-802630225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:38 devstack sudo[106856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe
Nov 07 02:50:38 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:38 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-414b97e8-73d9-4527-8ebb-6addc52a855d tempest-VolumeDependencyTests-802630225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe" returned: 0 in 0.346s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-414b97e8-73d9-4527-8ebb-6addc52a855d tempest-VolumeDependencyTests-802630225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:38 devstack sudo[106862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe
Nov 07 02:50:38 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:38 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-414b97e8-73d9-4527-8ebb-6addc52a855d tempest-VolumeDependencyTests-802630225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-911242a5-fb91-4895-ad31-576aeee96ffe" returned: 0 in 0.239s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:38 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-414b97e8-73d9-4527-8ebb-6addc52a855d tempest-VolumeDependencyTests-802630225 None] Lock "cinder-quobyte-911242a5-fb91-4895-ad31-576aeee96ffe" released by "delete_volume" :: held 0.644s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:38 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-414b97e8-73d9-4527-8ebb-6addc52a855d tempest-VolumeDependencyTests-802630225 None] Created reservations ['c1db1b58-2779-4cd4-8058-426ac7668f5b', 'e36d3b9d-9d98-4bee-a18a-b36e103143bb', '03d1dbbd-47b8-4d9a-9eae-c6dabb5b4f1c', 'a4163b73-6740-4392-9fe6-3e048d8ede73'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:50:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-414b97e8-73d9-4527-8ebb-6addc52a855d tempest-VolumeDependencyTests-802630225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-414b97e8-73d9-4527-8ebb-6addc52a855d tempest-VolumeDependencyTests-802630225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-414b97e8-73d9-4527-8ebb-6addc52a855d tempest-VolumeDependencyTests-802630225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-414b97e8-73d9-4527-8ebb-6addc52a855d tempest-VolumeDependencyTests-802630225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-414b97e8-73d9-4527-8ebb-6addc52a855d tempest-VolumeDependencyTests-802630225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-414b97e8-73d9-4527-8ebb-6addc52a855d tempest-VolumeDependencyTests-802630225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:38 devstack sudo[106865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:50:38 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:38 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-414b97e8-73d9-4527-8ebb-6addc52a855d tempest-VolumeDependencyTests-802630225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.236s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:38 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-414b97e8-73d9-4527-8ebb-6addc52a855d tempest-VolumeDependencyTests-802630225 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:50:38 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-414b97e8-73d9-4527-8ebb-6addc52a855d tempest-VolumeDependencyTests-802630225 None] Deleted volume successfully.
Nov 07 02:50:38 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-414b97e8-73d9-4527-8ebb-6addc52a855d tempest-VolumeDependencyTests-802630225 None] Lock "cinder-911242a5-fb91-4895-ad31-576aeee96ffe-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:39 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-25cfa9d9-afb2-443d-b3a9-e7a9f20f9454 tempest-VolumeDependencyTests-802630225 None] Acquiring lock "cinder-e86db826-f655-4a63-9b93-8aafeddf2835-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:39 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-25cfa9d9-afb2-443d-b3a9-e7a9f20f9454 tempest-VolumeDependencyTests-802630225 None] Lock "cinder-e86db826-f655-4a63-9b93-8aafeddf2835-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:39 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-25cfa9d9-afb2-443d-b3a9-e7a9f20f9454 tempest-VolumeDependencyTests-802630225 None] Acquiring lock "cinder-quobyte-e86db826-f655-4a63-9b93-8aafeddf2835" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:39 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-25cfa9d9-afb2-443d-b3a9-e7a9f20f9454 tempest-VolumeDependencyTests-802630225 None] Lock "cinder-quobyte-e86db826-f655-4a63-9b93-8aafeddf2835" acquired by "delete_volume" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:39 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bd87eb-06ad-4e05-a884-dcaa406c995c]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:50:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-25cfa9d9-afb2-443d-b3a9-e7a9f20f9454 tempest-VolumeDependencyTests-802630225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e86db826-f655-4a63-9b93-8aafeddf2835 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:39 devstack sudo[106868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e86db826-f655-4a63-9b93-8aafeddf2835
Nov 07 02:50:39 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:39 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-25cfa9d9-afb2-443d-b3a9-e7a9f20f9454 tempest-VolumeDependencyTests-802630225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e86db826-f655-4a63-9b93-8aafeddf2835" returned: 0 in 0.357s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-25cfa9d9-afb2-443d-b3a9-e7a9f20f9454 tempest-VolumeDependencyTests-802630225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e86db826-f655-4a63-9b93-8aafeddf2835 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:39 devstack sudo[106874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e86db826-f655-4a63-9b93-8aafeddf2835
Nov 07 02:50:39 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:39 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-25cfa9d9-afb2-443d-b3a9-e7a9f20f9454 tempest-VolumeDependencyTests-802630225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e86db826-f655-4a63-9b93-8aafeddf2835" returned: 0 in 0.234s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:39 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-25cfa9d9-afb2-443d-b3a9-e7a9f20f9454 tempest-VolumeDependencyTests-802630225 None] Lock "cinder-quobyte-e86db826-f655-4a63-9b93-8aafeddf2835" released by "delete_volume" :: held 0.631s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:39 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-25cfa9d9-afb2-443d-b3a9-e7a9f20f9454 tempest-VolumeDependencyTests-802630225 None] Created reservations ['40007800-3a3d-48ea-880f-db486a887b0f', '88aa7cc8-32a7-4931-9a16-c7aaff17177a', '237da426-2adf-458d-b014-fc1be037b081', '87a74e2c-243c-49f3-a31c-a26f5d40b237'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:50:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-25cfa9d9-afb2-443d-b3a9-e7a9f20f9454 tempest-VolumeDependencyTests-802630225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-25cfa9d9-afb2-443d-b3a9-e7a9f20f9454 tempest-VolumeDependencyTests-802630225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-25cfa9d9-afb2-443d-b3a9-e7a9f20f9454 tempest-VolumeDependencyTests-802630225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:39 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-25cfa9d9-afb2-443d-b3a9-e7a9f20f9454 tempest-VolumeDependencyTests-802630225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-25cfa9d9-afb2-443d-b3a9-e7a9f20f9454 tempest-VolumeDependencyTests-802630225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-25cfa9d9-afb2-443d-b3a9-e7a9f20f9454 tempest-VolumeDependencyTests-802630225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:39 devstack sudo[106877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:50:39 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:40 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-25cfa9d9-afb2-443d-b3a9-e7a9f20f9454 tempest-VolumeDependencyTests-802630225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.244s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:40 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-25cfa9d9-afb2-443d-b3a9-e7a9f20f9454 tempest-VolumeDependencyTests-802630225 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:50:40 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-25cfa9d9-afb2-443d-b3a9-e7a9f20f9454 tempest-VolumeDependencyTests-802630225 None] Deleted volume successfully.
Nov 07 02:50:40 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-25cfa9d9-afb2-443d-b3a9-e7a9f20f9454 tempest-VolumeDependencyTests-802630225 None] Lock "cinder-e86db826-f655-4a63-9b93-8aafeddf2835-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Flow 'volume_create_manager' (a2b3d5f9-086b-46dd-89a8-9c9a5b009458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7634d2b-be34-4318-98ad-e7470ef3517c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7634d2b-be34-4318-98ad-e7470ef3517c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1892495754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b2be76e-6b91-47a3-aa49-e4e784b2bd7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d94c642c524293b5d78d18ce4c2f8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:50:43Z,use_quota=True,user_id='1a41ed83fe5b4a1193530aacf8d22921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4083f9bb-2d5c-40d5-9013-02fcbeb0347b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4083f9bb-2d5c-40d5-9013-02fcbeb0347b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c98d88-c797-40a0-b53d-091834059869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c98d88-c797-40a0-b53d-091834059869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b2be76e-6b91-47a3-aa49-e4e784b2bd7f', 'volume_name': 'volume-2b2be76e-6b91-47a3-aa49-e4e784b2bd7f', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a9e6ed-3428-458b-ae42-6f467397945d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a9e6ed-3428-458b-ae42-6f467397945d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db0c694e-7352-401d-9ae7-af862ffacf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:43 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Volume 2b2be76e-6b91-47a3-aa49-e4e784b2bd7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b2be76e-6b91-47a3-aa49-e4e784b2bd7f', 'volume_size': 1}
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1892495754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b2be76e-6b91-47a3-aa49-e4e784b2bd7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d94c642c524293b5d78d18ce4c2f8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:50:43Z,use_quota=True,user_id='1a41ed83fe5b4a1193530aacf8d22921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Creating volume 2b2be76e-6b91-47a3-aa49-e4e784b2bd7f {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:50:43 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2b2be76e-6b91-47a3-aa49-e4e784b2bd7f 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:43 devstack sudo[106882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2b2be76e-6b91-47a3-aa49-e4e784b2bd7f 1073741824
Nov 07 02:50:43 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:43 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2b2be76e-6b91-47a3-aa49-e4e784b2bd7f 1073741824" returned: 0 in 0.406s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2b2be76e-6b91-47a3-aa49-e4e784b2bd7f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:43 devstack sudo[106887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2b2be76e-6b91-47a3-aa49-e4e784b2bd7f
Nov 07 02:50:43 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:44 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2b2be76e-6b91-47a3-aa49-e4e784b2bd7f" returned: 0 in 0.255s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:50:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db0c694e-7352-401d-9ae7-af862ffacf1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b2be76e-6b91-47a3-aa49-e4e784b2bd7f', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0f1390-223c-4ad5-81d6-a1cc3efa0de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:44 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Volume volume-2b2be76e-6b91-47a3-aa49-e4e784b2bd7f (2b2be76e-6b91-47a3-aa49-e4e784b2bd7f): created successfully
Nov 07 02:50:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0f1390-223c-4ad5-81d6-a1cc3efa0de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Flow 'volume_create_manager' (a2b3d5f9-086b-46dd-89a8-9c9a5b009458) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:50:44 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f13902be-bc3f-4e0e-9fb2-f484ac553141 tempest-ProjectReaderTests-1996090993 None] Created volume successfully.
Nov 07 02:50:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b4adaed1-6ae6-4e19-be24-41fa0534098e tempest-ProjectReaderTests-1996090993 None] Acquiring lock "cinder-2b2be76e-6b91-47a3-aa49-e4e784b2bd7f-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b4adaed1-6ae6-4e19-be24-41fa0534098e tempest-ProjectReaderTests-1996090993 None] Lock "cinder-2b2be76e-6b91-47a3-aa49-e4e784b2bd7f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b4adaed1-6ae6-4e19-be24-41fa0534098e tempest-ProjectReaderTests-1996090993 None] Acquiring lock "cinder-quobyte-2b2be76e-6b91-47a3-aa49-e4e784b2bd7f" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b4adaed1-6ae6-4e19-be24-41fa0534098e tempest-ProjectReaderTests-1996090993 None] Lock "cinder-quobyte-2b2be76e-6b91-47a3-aa49-e4e784b2bd7f" acquired by "delete_volume" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:44 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2846d1-4104-422b-8b5d-78780b8bf9bd]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:50:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b4adaed1-6ae6-4e19-be24-41fa0534098e tempest-ProjectReaderTests-1996090993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2b2be76e-6b91-47a3-aa49-e4e784b2bd7f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:44 devstack sudo[106890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2b2be76e-6b91-47a3-aa49-e4e784b2bd7f
Nov 07 02:50:44 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:45 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b4adaed1-6ae6-4e19-be24-41fa0534098e tempest-ProjectReaderTests-1996090993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2b2be76e-6b91-47a3-aa49-e4e784b2bd7f" returned: 0 in 0.351s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b4adaed1-6ae6-4e19-be24-41fa0534098e tempest-ProjectReaderTests-1996090993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2b2be76e-6b91-47a3-aa49-e4e784b2bd7f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:45 devstack sudo[106895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2b2be76e-6b91-47a3-aa49-e4e784b2bd7f
Nov 07 02:50:45 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:45 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b4adaed1-6ae6-4e19-be24-41fa0534098e tempest-ProjectReaderTests-1996090993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2b2be76e-6b91-47a3-aa49-e4e784b2bd7f" returned: 0 in 0.239s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:45 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b4adaed1-6ae6-4e19-be24-41fa0534098e tempest-ProjectReaderTests-1996090993 None] Lock "cinder-quobyte-2b2be76e-6b91-47a3-aa49-e4e784b2bd7f" released by "delete_volume" :: held 0.630s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:45 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-b4adaed1-6ae6-4e19-be24-41fa0534098e tempest-ProjectReaderTests-1996090993 None] Created reservations ['ff9a8c82-5234-47bf-9f6e-a82314b65883', '6b7822eb-e4f6-415b-ab71-1d69d6407103', '4dca0d3e-41c7-4f66-82da-3641b4fd37da', '0720c675-013a-4cf7-bf67-6812b6f45815'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:50:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b4adaed1-6ae6-4e19-be24-41fa0534098e tempest-ProjectReaderTests-1996090993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b4adaed1-6ae6-4e19-be24-41fa0534098e tempest-ProjectReaderTests-1996090993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b4adaed1-6ae6-4e19-be24-41fa0534098e tempest-ProjectReaderTests-1996090993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b4adaed1-6ae6-4e19-be24-41fa0534098e tempest-ProjectReaderTests-1996090993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b4adaed1-6ae6-4e19-be24-41fa0534098e tempest-ProjectReaderTests-1996090993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b4adaed1-6ae6-4e19-be24-41fa0534098e tempest-ProjectReaderTests-1996090993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:45 devstack sudo[106898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:50:45 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:45 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b4adaed1-6ae6-4e19-be24-41fa0534098e tempest-ProjectReaderTests-1996090993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.260s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:45 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-b4adaed1-6ae6-4e19-be24-41fa0534098e tempest-ProjectReaderTests-1996090993 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:50:45 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b4adaed1-6ae6-4e19-be24-41fa0534098e tempest-ProjectReaderTests-1996090993 None] Deleted volume successfully.
Nov 07 02:50:45 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b4adaed1-6ae6-4e19-be24-41fa0534098e tempest-ProjectReaderTests-1996090993 None] Lock "cinder-2b2be76e-6b91-47a3-aa49-e4e784b2bd7f-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Flow 'volume_create_manager' (091cfaa2-17e7-459e-9d95-43199bfd026c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0838a6-75e6-4c4c-a239-39714f9d9199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0838a6-75e6-4c4c-a239-39714f9d9199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-568058678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfaf90b2-b9d2-4a80-adfa-496411e5552c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d94c642c524293b5d78d18ce4c2f8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:50:46Z,use_quota=True,user_id='1a41ed83fe5b4a1193530aacf8d22921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f617cac-0dd4-4e4b-a417-f9734ee9651e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f617cac-0dd4-4e4b-a417-f9734ee9651e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72136181-003b-41bd-9ebf-6fb81c4a2447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72136181-003b-41bd-9ebf-6fb81c4a2447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfaf90b2-b9d2-4a80-adfa-496411e5552c', 'volume_name': 'volume-cfaf90b2-b9d2-4a80-adfa-496411e5552c', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9ddd30-0cd2-4b5a-b66f-620e8ee5f279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9ddd30-0cd2-4b5a-b66f-620e8ee5f279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4cbd8b5-054f-461e-91dc-2a239e5fed7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:46 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Volume cfaf90b2-b9d2-4a80-adfa-496411e5552c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfaf90b2-b9d2-4a80-adfa-496411e5552c', 'volume_size': 1}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-568058678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfaf90b2-b9d2-4a80-adfa-496411e5552c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d94c642c524293b5d78d18ce4c2f8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:50:46Z,use_quota=True,user_id='1a41ed83fe5b4a1193530aacf8d22921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Creating volume cfaf90b2-b9d2-4a80-adfa-496411e5552c {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:50:46 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cfaf90b2-b9d2-4a80-adfa-496411e5552c 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:46 devstack sudo[106901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cfaf90b2-b9d2-4a80-adfa-496411e5552c 1073741824
Nov 07 02:50:46 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:46 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cfaf90b2-b9d2-4a80-adfa-496411e5552c 1073741824" returned: 0 in 0.400s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cfaf90b2-b9d2-4a80-adfa-496411e5552c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:46 devstack sudo[106906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cfaf90b2-b9d2-4a80-adfa-496411e5552c
Nov 07 02:50:46 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:46 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cfaf90b2-b9d2-4a80-adfa-496411e5552c" returned: 0 in 0.244s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4cbd8b5-054f-461e-91dc-2a239e5fed7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfaf90b2-b9d2-4a80-adfa-496411e5552c', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336b9bf4-aaf1-43b8-b541-6c2022d5299a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:50:46 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Volume volume-cfaf90b2-b9d2-4a80-adfa-496411e5552c (cfaf90b2-b9d2-4a80-adfa-496411e5552c): created successfully
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336b9bf4-aaf1-43b8-b541-6c2022d5299a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:50:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Flow 'volume_create_manager' (091cfaa2-17e7-459e-9d95-43199bfd026c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:50:46 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-7eebcc3d-0b33-4dbc-beb9-c00fbe2a63d4 tempest-ProjectReaderTests-1996090993 None] Created volume successfully.
Nov 07 02:50:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-15fd23de-6195-413f-8242-bef98f91fbb9 tempest-ProjectReaderTests-1996090993 None] Acquiring lock "cinder-cfaf90b2-b9d2-4a80-adfa-496411e5552c-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-15fd23de-6195-413f-8242-bef98f91fbb9 tempest-ProjectReaderTests-1996090993 None] Lock "cinder-cfaf90b2-b9d2-4a80-adfa-496411e5552c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-15fd23de-6195-413f-8242-bef98f91fbb9 tempest-ProjectReaderTests-1996090993 None] Acquiring lock "cinder-quobyte-cfaf90b2-b9d2-4a80-adfa-496411e5552c" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:50:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-15fd23de-6195-413f-8242-bef98f91fbb9 tempest-ProjectReaderTests-1996090993 None] Lock "cinder-quobyte-cfaf90b2-b9d2-4a80-adfa-496411e5552c" acquired by "delete_volume" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:50:47 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3f2838-aa6e-4f29-a004-dd6fa65234f5]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:50:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-15fd23de-6195-413f-8242-bef98f91fbb9 tempest-ProjectReaderTests-1996090993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cfaf90b2-b9d2-4a80-adfa-496411e5552c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:47 devstack sudo[106909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cfaf90b2-b9d2-4a80-adfa-496411e5552c
Nov 07 02:50:47 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:47 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-15fd23de-6195-413f-8242-bef98f91fbb9 tempest-ProjectReaderTests-1996090993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cfaf90b2-b9d2-4a80-adfa-496411e5552c" returned: 0 in 0.351s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-15fd23de-6195-413f-8242-bef98f91fbb9 tempest-ProjectReaderTests-1996090993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cfaf90b2-b9d2-4a80-adfa-496411e5552c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:47 devstack sudo[106914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cfaf90b2-b9d2-4a80-adfa-496411e5552c
Nov 07 02:50:47 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:47 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-15fd23de-6195-413f-8242-bef98f91fbb9 tempest-ProjectReaderTests-1996090993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-cfaf90b2-b9d2-4a80-adfa-496411e5552c" returned: 0 in 0.247s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-15fd23de-6195-413f-8242-bef98f91fbb9 tempest-ProjectReaderTests-1996090993 None] Lock "cinder-quobyte-cfaf90b2-b9d2-4a80-adfa-496411e5552c" released by "delete_volume" :: held 0.644s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:47 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-15fd23de-6195-413f-8242-bef98f91fbb9 tempest-ProjectReaderTests-1996090993 None] Created reservations ['7e926dd5-3b2e-46ad-b9a0-95d1ee8ad377', 'b5996b9b-86c5-4cdf-b80f-3e6d784fe5df', '4329fe19-f46c-4ef2-8c4b-a2bb57d08474', '79a3a992-a0db-4516-955a-99a6648a23a3'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:50:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-15fd23de-6195-413f-8242-bef98f91fbb9 tempest-ProjectReaderTests-1996090993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-15fd23de-6195-413f-8242-bef98f91fbb9 tempest-ProjectReaderTests-1996090993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-15fd23de-6195-413f-8242-bef98f91fbb9 tempest-ProjectReaderTests-1996090993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-15fd23de-6195-413f-8242-bef98f91fbb9 tempest-ProjectReaderTests-1996090993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-15fd23de-6195-413f-8242-bef98f91fbb9 tempest-ProjectReaderTests-1996090993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-15fd23de-6195-413f-8242-bef98f91fbb9 tempest-ProjectReaderTests-1996090993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:48 devstack sudo[106917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:50:48 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:48 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-15fd23de-6195-413f-8242-bef98f91fbb9 tempest-ProjectReaderTests-1996090993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.247s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:48 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-15fd23de-6195-413f-8242-bef98f91fbb9 tempest-ProjectReaderTests-1996090993 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:50:48 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-15fd23de-6195-413f-8242-bef98f91fbb9 tempest-ProjectReaderTests-1996090993 None] Deleted volume successfully.
Nov 07 02:50:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-15fd23de-6195-413f-8242-bef98f91fbb9 tempest-ProjectReaderTests-1996090993 None] Lock "cinder-cfaf90b2-b9d2-4a80-adfa-496411e5552c-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:50:57 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=73,cinder:UPDATE=106,cinder:INSERT=29,cinder:DELETE=10 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:50:58 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=74,cinder:UPDATE=106,cinder:DELETE=9,cinder:INSERT=21 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:50:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:50:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:50:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:50:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:50:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:50:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:50:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:50:59 devstack sudo[106924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:50:59 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:50:59 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root
Nov 07 02:50:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.268s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:50:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:50:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:50:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 28 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:50:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>, <Thread(fd_logger, started daemon 125443282798592)>, <Thread(privsep_reader, started daemon 125443284556288)>, <Thread(tpool_thread_0, started daemon 125443276445376)>, <Thread(tpool_thread_1, started daemon 125443268036288)>, <Thread(tpool_thread_2, started daemon 125443259627200)>, <Thread(tpool_thread_3, started daemon 125443251218112)>, <Thread(tpool_thread_4, started daemon 125443242809024)>, <Thread(tpool_thread_5, started daemon 125443234399936)>, <Thread(tpool_thread_6, started daemon 125443225990848)>, <Thread(tpool_thread_7, started daemon 125443217581760)>, <Thread(tpool_thread_8, started daemon 125443209172672)>, <Thread(tpool_thread_9, started daemon 125443200763584)>, <Thread(tpool_thread_10, started daemon 125443192354496)>, <Thread(tpool_thread_11, started daemon 125443183945408)>, <Thread(tpool_thread_12, started daemon 125443175536320)>, <Thread(tpool_thread_13, started daemon 125443167127232)>, <Thread(tpool_thread_14, started daemon 125443158718144)>, <Thread(tpool_thread_15, started daemon 125443150309056)>, <Thread(tpool_thread_16, started daemon 125443141899968)>, <Thread(tpool_thread_17, started daemon 125443133490880)>, <Thread(tpool_thread_18, started daemon 125443125081792)>, <Thread(tpool_thread_19, started daemon 125443116672704)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Flow 'volume_create_manager' (75d01d65-5645-4c93-92c2-d6bd5c2f2c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ed2c0b1-a3ac-435b-aa2c-530adc220e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ed2c0b1-a3ac-435b-aa2c-530adc220e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-208291396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c67174-d606-4113-b0da-bcbdba679610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41216a3ae0d4b43b4040043991b94c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:08Z,use_quota=True,user_id='1cf3e3705fbb4a3ca3bd960485bfafe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae5e949-a4ba-4160-adc9-50cd7a21cbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae5e949-a4ba-4160-adc9-50cd7a21cbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69906192-1eb8-460d-9390-56fb8142b179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69906192-1eb8-460d-9390-56fb8142b179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4c67174-d606-4113-b0da-bcbdba679610', 'volume_name': 'volume-e4c67174-d606-4113-b0da-bcbdba679610', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb7fc3a-2d65-4f0b-8016-0d9e5006d016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb7fc3a-2d65-4f0b-8016-0d9e5006d016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa39cac-b606-48e2-ab64-bda52a2b4fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:08 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Volume e4c67174-d606-4113-b0da-bcbdba679610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4c67174-d606-4113-b0da-bcbdba679610', 'volume_size': 1}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-208291396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c67174-d606-4113-b0da-bcbdba679610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41216a3ae0d4b43b4040043991b94c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:08Z,use_quota=True,user_id='1cf3e3705fbb4a3ca3bd960485bfafe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Creating volume e4c67174-d606-4113-b0da-bcbdba679610 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:08 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:08 devstack sudo[107001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610 1073741824
Nov 07 02:51:08 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:08 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610 1073741824" returned: 0 in 0.573s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Flow 'volume_create_manager' (db24a3f1-4705-4548-a15e-e453dda59aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bca732dd-4fac-45ab-88f9-c375d6b98ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bca732dd-4fac-45ab-88f9-c375d6b98ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a10421fa-7304-4460-824e-83ba65fd2fad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dabcbf32245f46a595a7d3a9c536e379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:09Z,use_quota=True,user_id='02cee1c825c448b297d2f42f9fedb734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359c8818-3b25-42ae-897b-e86526901410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:08 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359c8818-3b25-42ae-897b-e86526901410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9704bec-3b8e-4034-b48e-15a5da06183e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9704bec-3b8e-4034-b48e-15a5da06183e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a10421fa-7304-4460-824e-83ba65fd2fad', 'volume_name': 'volume-a10421fa-7304-4460-824e-83ba65fd2fad', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7fae866-b41c-4a41-9124-e56a00825088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7fae866-b41c-4a41-9124-e56a00825088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699938b0-f8ea-469d-9294-dc02c4dd5988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:09 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Volume a10421fa-7304-4460-824e-83ba65fd2fad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a10421fa-7304-4460-824e-83ba65fd2fad', 'volume_size': 1}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:09 devstack sudo[107007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610
Nov 07 02:51:09 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Flow 'volume_create_manager' (f5678f52-eab4-4b40-885a-6fa2e199865a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304d1ad4-30f5-46c0-8153-21902317ca05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304d1ad4-30f5-46c0-8153-21902317ca05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-356953154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4586c3171824ef3a958a9d459e115b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:09Z,use_quota=True,user_id='ef0c45a577784d8080c13e0e93b4c8cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e884745-1acd-4bfa-bd13-4d34f28443fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e884745-1acd-4bfa-bd13-4d34f28443fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab75e33-99cb-4662-a49a-1277f4144ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab75e33-99cb-4662-a49a-1277f4144ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b', 'volume_name': 'volume-26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f304daf5-71eb-4f94-beed-5d05cf9f79e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f304daf5-71eb-4f94-beed-5d05cf9f79e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (002636d2-6605-4a9d-8cc2-1b11db959a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:09 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Volume 26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b', 'volume_size': 1}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:09 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610" returned: 0 in 0.288s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.306s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a10421fa-7304-4460-824e-83ba65fd2fad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dabcbf32245f46a595a7d3a9c536e379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:09Z,use_quota=True,user_id='02cee1c825c448b297d2f42f9fedb734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Creating volume a10421fa-7304-4460-824e-83ba65fd2fad {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:09 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a10421fa-7304-4460-824e-83ba65fd2fad 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa39cac-b606-48e2-ab64-bda52a2b4fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4c67174-d606-4113-b0da-bcbdba679610', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d5a17f-5ced-4b4b-a210-ed5e7321b77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:09 devstack sudo[107010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a10421fa-7304-4460-824e-83ba65fd2fad 1073741824
Nov 07 02:51:09 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:09 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Volume volume-e4c67174-d606-4113-b0da-bcbdba679610 (e4c67174-d606-4113-b0da-bcbdba679610): created successfully
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d5a17f-5ced-4b4b-a210-ed5e7321b77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Flow 'volume_create_manager' (75d01d65-5645-4c93-92c2-d6bd5c2f2c3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:09 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-51f4f066-1bf8-4ad3-ba49-a006d249fae5 tempest-CreateVolumesFromSnapshotTest-239707012 None] Created volume successfully.
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a54a810a-525f-4687-bbcd-03a6ad3e0059 tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:09 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a10421fa-7304-4460-824e-83ba65fd2fad 1073741824" returned: 0 in 0.545s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a10421fa-7304-4460-824e-83ba65fd2fad {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:09 devstack sudo[107016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a10421fa-7304-4460-824e-83ba65fd2fad
Nov 07 02:51:09 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:10 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a10421fa-7304-4460-824e-83ba65fd2fad" returned: 0 in 0.258s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:10 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.033s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:10 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-356953154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4586c3171824ef3a958a9d459e115b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:09Z,use_quota=True,user_id='ef0c45a577784d8080c13e0e93b4c8cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:10 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Creating volume 26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:10 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:10 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:10 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:10 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:10 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699938b0-f8ea-469d-9294-dc02c4dd5988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a10421fa-7304-4460-824e-83ba65fd2fad', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:10 devstack sudo[107019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b 1073741824
Nov 07 02:51:10 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:10 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2ab2bb-1c55-41cf-a5c0-bf512678cd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:10 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Volume volume-a10421fa-7304-4460-824e-83ba65fd2fad (a10421fa-7304-4460-824e-83ba65fd2fad): created successfully
Nov 07 02:51:10 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2ab2bb-1c55-41cf-a5c0-bf512678cd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:10 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Flow 'volume_create_manager' (db24a3f1-4705-4548-a15e-e453dda59aca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:10 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-d7eef0d4-7f0e-4f12-89de-95e4fb531581 tempest-CinderUnicodeTest-1297222973 None] Created volume successfully.
Nov 07 02:51:10 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b 1073741824" returned: 0 in 0.484s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:10 devstack sudo[107025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b
Nov 07 02:51:10 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:10 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b" returned: 0 in 0.286s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:10 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a54a810a-525f-4687-bbcd-03a6ad3e0059 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.152s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (002636d2-6605-4a9d-8cc2-1b11db959a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df73b9b-97b7-4570-a95f-299318adcbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-a54a810a-525f-4687-bbcd-03a6ad3e0059 tempest-CreateVolumesFromSnapshotTest-239707012 None] Creating offline snapshot 5c1a95f4-2b65-4062-a32a-6af90dd64305 of volume e4c67174-d606-4113-b0da-bcbdba679610 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:51:11 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Volume volume-26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b (26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b): created successfully
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df73b9b-97b7-4570-a95f-299318adcbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Flow 'volume_create_manager' (f5678f52-eab4-4b40-885a-6fa2e199865a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b50cfe-1a64-4d13-a9e2-fd9eba72cdd8]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a54a810a-525f-4687-bbcd-03a6ad3e0059 tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:11 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f6c9bb7e-9565-4d2d-9c50-25d9e3c0c5c8 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Created volume successfully.
Nov 07 02:51:11 devstack sudo[107028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610
Nov 07 02:51:11 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Flow 'volume_create_manager' (a8f5a50f-3166-48f5-bb32-a2854aa2e8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0fba48-9a51-48c4-9371-abd4285c4967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0fba48-9a51-48c4-9371-abd4285c4967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1713566328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d7c1fb5-61fe-4915-a07d-311aa8d46351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dabcbf32245f46a595a7d3a9c536e379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:11Z,use_quota=True,user_id='02cee1c825c448b297d2f42f9fedb734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc348409-0749-4dc1-bc5b-0c7a9e7be522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc348409-0749-4dc1-bc5b-0c7a9e7be522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddab9cad-d09a-4736-bfb5-e3e9fa25068e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddab9cad-d09a-4736-bfb5-e3e9fa25068e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d7c1fb5-61fe-4915-a07d-311aa8d46351', 'volume_name': 'volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1465fbe-dcde-4e57-b1bd-0f0da4a0483b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1465fbe-dcde-4e57-b1bd-0f0da4a0483b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a57b15ef-b3cf-4b89-bb27-5553441303b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:11 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Volume 3d7c1fb5-61fe-4915-a07d-311aa8d46351: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351', 'volume_size': 1}
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:11 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a54a810a-525f-4687-bbcd-03a6ad3e0059 tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610" returned: 0 in 0.449s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a54a810a-525f-4687-bbcd-03a6ad3e0059 tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.5c1a95f4-2b65-4062-a32a-6af90dd64305 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:11 devstack sudo[107033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.5c1a95f4-2b65-4062-a32a-6af90dd64305 1G
Nov 07 02:51:11 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:11 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a54a810a-525f-4687-bbcd-03a6ad3e0059 tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.5c1a95f4-2b65-4062-a32a-6af90dd64305 1G" returned: 0 in 0.430s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a54a810a-525f-4687-bbcd-03a6ad3e0059 tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c67174-d606-4113-b0da-bcbdba679610 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.5c1a95f4-2b65-4062-a32a-6af90dd64305 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:11 devstack sudo[107038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c67174-d606-4113-b0da-bcbdba679610 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.5c1a95f4-2b65-4062-a32a-6af90dd64305
Nov 07 02:51:11 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:12 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a54a810a-525f-4687-bbcd-03a6ad3e0059 tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c67174-d606-4113-b0da-bcbdba679610 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.5c1a95f4-2b65-4062-a32a-6af90dd64305" returned: 0 in 0.365s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:12 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-a54a810a-525f-4687-bbcd-03a6ad3e0059 tempest-CreateVolumesFromSnapshotTest-239707012 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.5c1a95f4-2b65-4062-a32a-6af90dd64305 is being set with open permissions: ugo+rw
Nov 07 02:51:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a54a810a-525f-4687-bbcd-03a6ad3e0059 tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.5c1a95f4-2b65-4062-a32a-6af90dd64305 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:12 devstack sudo[107043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.5c1a95f4-2b65-4062-a32a-6af90dd64305
Nov 07 02:51:12 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:12 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Flow 'volume_create_manager' (9c46e3d3-dba6-42e6-80de-f98dc64c9037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd62029-c79c-476a-bc44-b2cc2417b288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd62029-c79c-476a-bc44-b2cc2417b288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1689935486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a3c34e-7684-4233-89fd-702fd01f3bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4586c3171824ef3a958a9d459e115b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:12Z,use_quota=True,user_id='ef0c45a577784d8080c13e0e93b4c8cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98bb6212-61cf-4e63-8e3a-242212913ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98bb6212-61cf-4e63-8e3a-242212913ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d785db02-d71e-47e0-b9e8-c4ea3d7513db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d785db02-d71e-47e0-b9e8-c4ea3d7513db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07a3c34e-7684-4233-89fd-702fd01f3bc3', 'volume_name': 'volume-07a3c34e-7684-4233-89fd-702fd01f3bc3', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e511179d-b274-46f5-837d-f255d4753eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e511179d-b274-46f5-837d-f255d4753eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:12 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88dc3b74-395b-41c7-b371-21d526e52282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:12 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Volume 07a3c34e-7684-4233-89fd-702fd01f3bc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07a3c34e-7684-4233-89fd-702fd01f3bc3', 'volume_size': 1}
Nov 07 02:51:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:12 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a54a810a-525f-4687-bbcd-03a6ad3e0059 tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.5c1a95f4-2b65-4062-a32a-6af90dd64305" returned: 0 in 0.305s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a54a810a-525f-4687-bbcd-03a6ad3e0059 tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:12 devstack sudo[107046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.info
Nov 07 02:51:12 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:12 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a54a810a-525f-4687-bbcd-03a6ad3e0059 tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.info" returned: 0 in 0.302s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:12 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-a54a810a-525f-4687-bbcd-03a6ad3e0059 tempest-CreateVolumesFromSnapshotTest-239707012 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.info is being set with open permissions: ugo+rw
Nov 07 02:51:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a54a810a-525f-4687-bbcd-03a6ad3e0059 tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:13 devstack sudo[107049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.info
Nov 07 02:51:13 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Flow 'volume_create_manager' (28c6236f-1ca2-4301-9095-a7f31a4d8cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d55647b-6edc-4f49-ae03-424a702ffabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d55647b-6edc-4f49-ae03-424a702ffabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae16b068-dd08-4234-b976-0ba09d4a4a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfeba83ae0642e49029bb2f76cb3003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:13Z,use_quota=True,user_id='cb6344ffe0f3470abbad57cd55edaa4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab758e8-f6c8-4c4d-bff8-df32af482460),volume_type_id=8ab758e8-f6c8-4c4d-bff8-df32af482460)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a43eba-3adb-4525-a22d-4403f2c548f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a43eba-3adb-4525-a22d-4403f2c548f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6125a7bb-c562-41bd-87b1-f611cc544deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.image.glance [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Creating Keystone auth plugin from conf {{(pid=87054) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Flow 'volume_create_manager' (c3459b95-bbe6-4fb3-87f2-d36ad624fdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d80565-0473-420e-98e6-4505e4c9aeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:13 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a54a810a-525f-4687-bbcd-03a6ad3e0059 tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.info" returned: 0 in 0.289s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a54a810a-525f-4687-bbcd-03a6ad3e0059 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.285s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.801s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1713566328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d7c1fb5-61fe-4915-a07d-311aa8d46351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dabcbf32245f46a595a7d3a9c536e379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:11Z,use_quota=True,user_id='02cee1c825c448b297d2f42f9fedb734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Creating volume 3d7c1fb5-61fe-4915-a07d-311aa8d46351 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:13 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d80565-0473-420e-98e6-4505e4c9aeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-919498295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e5d94e-df72-4cca-96d9-78aafe92a9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4586c3171824ef3a958a9d459e115b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:13Z,use_quota=True,user_id='ef0c45a577784d8080c13e0e93b4c8cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb25ca5-53bb-4da7-bd5e-bebc623bec5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb25ca5-53bb-4da7-bd5e-bebc623bec5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad27c693-1398-4b78-b2bb-e3a6bc275a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad27c693-1398-4b78-b2bb-e3a6bc275a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51e5d94e-df72-4cca-96d9-78aafe92a9d3', 'volume_name': 'volume-51e5d94e-df72-4cca-96d9-78aafe92a9d3', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:13 devstack sudo[107052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351 1073741824
Nov 07 02:51:13 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0ceebc-22ec-4fc1-bb66-82b87f211d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0ceebc-22ec-4fc1-bb66-82b87f211d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5211627-7add-4c82-86a7-8359eaeabff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:13 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Volume 51e5d94e-df72-4cca-96d9-78aafe92a9d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51e5d94e-df72-4cca-96d9-78aafe92a9d3', 'volume_size': 1}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:13 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-a54a810a-525f-4687-bbcd-03a6ad3e0059 tempest-CreateVolumesFromSnapshotTest-239707012 None] Create snapshot completed successfully
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Flow 'volume_create_manager' (7b0fa650-6e10-4ba9-a684-71d1c4cdf4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b3a400-2759-495e-95c4-3140606ec65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b3a400-2759-495e-95c4-3140606ec65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1202142517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=827542c3-6fc6-4bb1-afda-8c8591a634a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4586c3171824ef3a958a9d459e115b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:13Z,use_quota=True,user_id='ef0c45a577784d8080c13e0e93b4c8cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c5b078-7ad2-4ad7-ad25-e72ab58a0778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c5b078-7ad2-4ad7-ad25-e72ab58a0778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120636b3-ed01-4eea-ae32-92d7f1bd1a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120636b3-ed01-4eea-ae32-92d7f1bd1a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '827542c3-6fc6-4bb1-afda-8c8591a634a6', 'volume_name': 'volume-827542c3-6fc6-4bb1-afda-8c8591a634a6', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6139895-525d-47dc-9ee6-e2879b3ffc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6139895-525d-47dc-9ee6-e2879b3ffc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9d0fe1-5db8-41bc-b1c4-aca5a0bd638f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:13 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Volume 827542c3-6fc6-4bb1-afda-8c8591a634a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-827542c3-6fc6-4bb1-afda-8c8591a634a6', 'volume_size': 1}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6125a7bb-c562-41bd-87b1-f611cc544deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ae16b068-dd08-4234-b976-0ba09d4a4a06', 'volume_name': 'volume-ae16b068-dd08-4234-b976-0ba09d4a4a06', 'volume_size': 1, 'image_id': '5a7d34a3-4cd4-410d-8a30-d64b13259d4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a7d34a3-4cd4-410d-8a30-d64b13259d4b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b7b2148538769f538840d3f6fefe5dc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7cfeba83ae0642e49029bb2f76cb3003', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '44d2d2c1d5b363c6ef8a8bb8e5552058a66b84d7351d70839c479132923b8cc2beacbf70e897fdeec2f8ebc1826eb40317d927821adebc23b8891ec5c3849712', 'id': '5a7d34a3-4cd4-410d-8a30-d64b13259d4b', 'created_at': datetime.datetime(2026, 11, 7, 1, 51, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 51, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a7d34a3-4cd4-410d-8a30-d64b13259d4b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7216ffd7e810>}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (943cf33d-d2c1-46b0-beb1-3dc9e3e60f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (943cf33d-d2c1-46b0-beb1-3dc9e3e60f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78f3846-687e-49a3-9a29-a34f2dbed823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:13 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Volume ae16b068-dd08-4234-b976-0ba09d4a4a06: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ae16b068-dd08-4234-b976-0ba09d4a4a06', 'volume_size': 1, 'image_id': '5a7d34a3-4cd4-410d-8a30-d64b13259d4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a7d34a3-4cd4-410d-8a30-d64b13259d4b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b7b2148538769f538840d3f6fefe5dc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7cfeba83ae0642e49029bb2f76cb3003', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '44d2d2c1d5b363c6ef8a8bb8e5552058a66b84d7351d70839c479132923b8cc2beacbf70e897fdeec2f8ebc1826eb40317d927821adebc23b8891ec5c3849712', 'id': '5a7d34a3-4cd4-410d-8a30-d64b13259d4b', 'created_at': datetime.datetime(2026, 11, 7, 1, 51, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 51, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a7d34a3-4cd4-410d-8a30-d64b13259d4b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7216ffd7e810>}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Trying to clone ae16b068-dd08-4234-b976-0ba09d4a4a06 from image 5a7d34a3-4cd4-410d-8a30-d64b13259d4b at location (None, [{'url': 'file:///opt/stack/data/glance/images/5a7d34a3-4cd4-410d-8a30-d64b13259d4b', 'metadata': {}}]). {{(pid=87054) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Flow 'volume_create_manager' (96e97be1-8405-4d02-b3f7-e5946d9af6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5178a077-42b0-4ee0-9c63-c1012794cfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:13 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 07 02:51:13 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Image download 0.00 MB at 0.00 MB/s
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5178a077-42b0-4ee0-9c63-c1012794cfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-71816411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c09e6c-8ac0-43d9-a21e-5231c4754ccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4586c3171824ef3a958a9d459e115b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:14Z,use_quota=True,user_id='ef0c45a577784d8080c13e0e93b4c8cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d52124-9c23-4eb2-af90-214a8905d377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d52124-9c23-4eb2-af90-214a8905d377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f925d5fb-776b-424e-9e35-c4ce09891a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f925d5fb-776b-424e-9e35-c4ce09891a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8c09e6c-8ac0-43d9-a21e-5231c4754ccf', 'volume_name': 'volume-d8c09e6c-8ac0-43d9-a21e-5231c4754ccf', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25893a1c-75f8-4c9b-88b9-58944ce9b5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25893a1c-75f8-4c9b-88b9-58944ce9b5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c984d5da-01bf-42b8-9eff-23c840aeddbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:13 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Volume d8c09e6c-8ac0-43d9-a21e-5231c4754ccf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8c09e6c-8ac0-43d9-a21e-5231c4754ccf', 'volume_size': 1}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351 1073741824" returned: 0 in 0.674s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7909fa6-a0ca-4d53-a5c6-3eb942bd0887]: (4, 'raw') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:14 devstack sudo[107059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351
Nov 07 02:51:14 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:14 devstack sudo[107058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD
Nov 07 02:51:14 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Flow 'volume_create_manager' (6bf5ebb2-6dd1-43e5-a2e8-b8275501482c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd7fc9b3-fc4a-4a7e-b20b-0bab95624c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd7fc9b3-fc4a-4a7e-b20b-0bab95624c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2008515329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6efbe5a9-e157-4eb4-86c3-a6399e53a1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4586c3171824ef3a958a9d459e115b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:14Z,use_quota=True,user_id='ef0c45a577784d8080c13e0e93b4c8cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b983bbf3-121f-41a2-a5db-a859a8d1b39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b983bbf3-121f-41a2-a5db-a859a8d1b39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e336dd4-3c13-45db-9af5-73f6121f5874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e336dd4-3c13-45db-9af5-73f6121f5874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6efbe5a9-e157-4eb4-86c3-a6399e53a1b2', 'volume_name': 'volume-6efbe5a9-e157-4eb4-86c3-a6399e53a1b2', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7279f900-4afa-498d-a17a-6efa3c92cc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7279f900-4afa-498d-a17a-6efa3c92cc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f157af9-c4f2-46f6-a030-d160138bd980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:14 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:14 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Volume 6efbe5a9-e157-4eb4-86c3-a6399e53a1b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6efbe5a9-e157-4eb4-86c3-a6399e53a1b2', 'volume_size': 1}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351" returned: 0 in 0.342s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.793s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1689935486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a3c34e-7684-4233-89fd-702fd01f3bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4586c3171824ef3a958a9d459e115b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:12Z,use_quota=True,user_id='ef0c45a577784d8080c13e0e93b4c8cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Creating volume 07a3c34e-7684-4233-89fd-702fd01f3bc3 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:14 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07a3c34e-7684-4233-89fd-702fd01f3bc3 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a57b15ef-b3cf-4b89-bb27-5553441303b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389adbe5-6008-49d3-b738-86229f630f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:14 devstack sudo[107063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07a3c34e-7684-4233-89fd-702fd01f3bc3 1073741824
Nov 07 02:51:14 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:14 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Volume volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351 (3d7c1fb5-61fe-4915-a07d-311aa8d46351): created successfully
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389adbe5-6008-49d3-b738-86229f630f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Flow 'volume_create_manager' (a8f5a50f-3166-48f5-bb32-a2854aa2e8ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:14 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD" returned: 0 in 0.496s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:14 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-89ed38a8-7bdb-4c87-84f3-593abc493506 tempest-CinderUnicodeTest-1297222973 None] Created volume successfully.
Nov 07 02:51:14 devstack sudo[107067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD
Nov 07 02:51:14 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Flow 'volume_create_manager' (010d0e0a-6848-424d-8749-81a36081709f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d7f536-4238-42f7-9ec5-9ed1538cd8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d7f536-4238-42f7-9ec5-9ed1538cd8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-802099557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38d9036-908f-4e98-aec9-0fa374ab84eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41216a3ae0d4b43b4040043991b94c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:15Z,use_quota=True,user_id='1cf3e3705fbb4a3ca3bd960485bfafe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b33753c-d4b5-4416-a9d4-7be0fa15a591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b33753c-d4b5-4416-a9d4-7be0fa15a591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f26903ac-1437-4ddd-885c-660b34c9395f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f26903ac-1437-4ddd-885c-660b34c9395f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f38d9036-908f-4e98-aec9-0fa374ab84eb', 'volume_name': 'volume-f38d9036-908f-4e98-aec9-0fa374ab84eb', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f8b533-45e4-4e43-9ef0-c3f47ba09817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f8b533-45e4-4e43-9ef0-c3f47ba09817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa84ffe-aef5-455d-a626-0cfe5c4cfec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:14 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Volume f38d9036-908f-4e98-aec9-0fa374ab84eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f38d9036-908f-4e98-aec9-0fa374ab84eb', 'volume_size': 1}
Nov 07 02:51:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:15 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07a3c34e-7684-4233-89fd-702fd01f3bc3 1073741824" returned: 0 in 0.604s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:15 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD" returned: 1 in 0.521s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Temporary image 5a7d34a3-4cd4-410d-8a30-d64b13259d4b is fetched for user cb6344ffe0f3470abbad57cd55edaa4f. {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07a3c34e-7684-4233-89fd-702fd01f3bc3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:15 devstack sudo[107082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07a3c34e-7684-4233-89fd-702fd01f3bc3
Nov 07 02:51:15 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de069bd-9ccd-4229-980e-97cc20cde2ba]: (4, 'raw') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:15 devstack sudo[107084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD
Nov 07 02:51:15 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:15 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07a3c34e-7684-4233-89fd-702fd01f3bc3" returned: 0 in 0.359s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.078s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-919498295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e5d94e-df72-4cca-96d9-78aafe92a9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4586c3171824ef3a958a9d459e115b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:13Z,use_quota=True,user_id='ef0c45a577784d8080c13e0e93b4c8cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Creating volume 51e5d94e-df72-4cca-96d9-78aafe92a9d3 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:15 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-51e5d94e-df72-4cca-96d9-78aafe92a9d3 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88dc3b74-395b-41c7-b371-21d526e52282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07a3c34e-7684-4233-89fd-702fd01f3bc3', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af75c8a0-796c-44ad-881d-d3fc6055b576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:15 devstack sudo[107087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-51e5d94e-df72-4cca-96d9-78aafe92a9d3 1073741824
Nov 07 02:51:15 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Flow 'volume_create_manager' (c665d315-a7b7-4d5a-b06e-d5790aeac38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d6d27c1-4723-4ce3-b10a-5481b51c5831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:15 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Volume volume-07a3c34e-7684-4233-89fd-702fd01f3bc3 (07a3c34e-7684-4233-89fd-702fd01f3bc3): created successfully
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af75c8a0-796c-44ad-881d-d3fc6055b576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Flow 'volume_create_manager' (9c46e3d3-dba6-42e6-80de-f98dc64c9037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d6d27c1-4723-4ce3-b10a-5481b51c5831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1751029912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c325643f-d645-4349-94e8-34db6558d626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41216a3ae0d4b43b4040043991b94c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:15Z,use_quota=True,user_id='1cf3e3705fbb4a3ca3bd960485bfafe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c651ca-d1a3-4b4b-abfc-4dd160f62ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c651ca-d1a3-4b4b-abfc-4dd160f62ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9290061-e854-4d1d-8790-2726d34aaf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9290061-e854-4d1d-8790-2726d34aaf0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c325643f-d645-4349-94e8-34db6558d626', 'volume_name': 'volume-c325643f-d645-4349-94e8-34db6558d626', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b74d7e2-0367-4abd-b3e0-1752cd28d6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b74d7e2-0367-4abd-b3e0-1752cd28d6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121464c8-9e25-46a3-9777-7ad583c71688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:15 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Volume c325643f-d645-4349-94e8-34db6558d626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c325643f-d645-4349-94e8-34db6558d626', 'volume_size': 1}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:15 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:15 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-a10c2f18-2f47-4dc6-b297-d76da070055d tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Created volume successfully.
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD" returned: 0 in 0.508s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Flow 'volume_create_manager' (28c59211-56ef-4f91-8ec9-5e0842a9faed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93e60e0-8d4e-4934-9cbd-d4266afaae3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ab28ad01-f737-4a01-bf43-8bf5b2034f03 tempest-CinderUnicodeTest-1297222973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93e60e0-8d4e-4934-9cbd-d4266afaae3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1034420960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45bdb638-0514-484c-8b92-a6371d15b983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41216a3ae0d4b43b4040043991b94c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:16Z,use_quota=True,user_id='1cf3e3705fbb4a3ca3bd960485bfafe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab8e7b1-2615-4c7a-897b-9f9673a274c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab8e7b1-2615-4c7a-897b-9f9673a274c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4aba26c-2ad6-4dee-9331-a02fc30bf7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4aba26c-2ad6-4dee-9331-a02fc30bf7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45bdb638-0514-484c-8b92-a6371d15b983', 'volume_name': 'volume-45bdb638-0514-484c-8b92-a6371d15b983', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5db7640-74bc-4a0c-8e11-f8777d0a44a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5db7640-74bc-4a0c-8e11-f8777d0a44a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381eb676-536f-4ebb-8f68-1f92009b73a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:15 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Volume 45bdb638-0514-484c-8b92-a6371d15b983: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45bdb638-0514-484c-8b92-a6371d15b983', 'volume_size': 1}
Nov 07 02:51:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:15 devstack sudo[107091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD
Nov 07 02:51:15 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:16 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD" returned: 1 in 0.372s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:16 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-51e5d94e-df72-4cca-96d9-78aafe92a9d3 1073741824" returned: 0 in 0.609s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Flow 'volume_create_manager' (a0571f2a-561f-4af2-b4d5-f7fb628db743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b1f456-47fe-4b89-aa42-c0e28a25e7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-51e5d94e-df72-4cca-96d9-78aafe92a9d3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b1f456-47fe-4b89-aa42-c0e28a25e7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1408793105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e237d4-c6fc-4133-88fe-8eb6fd873d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41216a3ae0d4b43b4040043991b94c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:16Z,use_quota=True,user_id='1cf3e3705fbb4a3ca3bd960485bfafe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2725c3-5c98-4cb2-8d58-0095c52ec62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:16 devstack sudo[107099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-51e5d94e-df72-4cca-96d9-78aafe92a9d3
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2725c3-5c98-4cb2-8d58-0095c52ec62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:16 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da98226-fbaa-4644-abe2-a54ae518e57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da98226-fbaa-4644-abe2-a54ae518e57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92e237d4-c6fc-4133-88fe-8eb6fd873d58', 'volume_name': 'volume-92e237d4-c6fc-4133-88fe-8eb6fd873d58', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c8bd9e5-46f1-46f4-92e5-f0a11b0f5a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c8bd9e5-46f1-46f4-92e5-f0a11b0f5a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6eb3bf-c9c9-4787-a9ee-dfc14e700e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:16 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Volume 92e237d4-c6fc-4133-88fe-8eb6fd873d58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92e237d4-c6fc-4133-88fe-8eb6fd873d58', 'volume_size': 1}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:16 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-51e5d94e-df72-4cca-96d9-78aafe92a9d3" returned: 0 in 0.265s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.914s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1202142517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=827542c3-6fc6-4bb1-afda-8c8591a634a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4586c3171824ef3a958a9d459e115b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:13Z,use_quota=True,user_id='ef0c45a577784d8080c13e0e93b4c8cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Creating volume 827542c3-6fc6-4bb1-afda-8c8591a634a6 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:16 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-827542c3-6fc6-4bb1-afda-8c8591a634a6 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5211627-7add-4c82-86a7-8359eaeabff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51e5d94e-df72-4cca-96d9-78aafe92a9d3', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:16 devstack sudo[107102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-827542c3-6fc6-4bb1-afda-8c8591a634a6 1073741824
Nov 07 02:51:16 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d55a969-50be-42c8-83eb-71fb530b94a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:16 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Volume volume-51e5d94e-df72-4cca-96d9-78aafe92a9d3 (51e5d94e-df72-4cca-96d9-78aafe92a9d3): created successfully
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d55a969-50be-42c8-83eb-71fb530b94a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Flow 'volume_create_manager' (c3459b95-bbe6-4fb3-87f2-d36ad624fdac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:16 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-3e64448b-3ebd-4316-8f14-d9f506bc776f tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Created volume successfully.
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Flow 'volume_create_manager' (44e41386-a8da-4ebf-b73e-df571e32238c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (448d826f-eef1-42b7-b1fd-b5a11e2c7dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (448d826f-eef1-42b7-b1fd-b5a11e2c7dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1369395949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ecea41-1ad7-4eb7-bb02-9393c691a71e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41216a3ae0d4b43b4040043991b94c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:16Z,use_quota=True,user_id='1cf3e3705fbb4a3ca3bd960485bfafe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a56deff8-8196-4118-b83f-4b65bfd87d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a56deff8-8196-4118-b83f-4b65bfd87d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc8ff87-f5c2-4853-827e-33da8e8d3750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc8ff87-f5c2-4853-827e-33da8e8d3750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8ecea41-1ad7-4eb7-bb02-9393c691a71e', 'volume_name': 'volume-c8ecea41-1ad7-4eb7-bb02-9393c691a71e', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d361135-661a-46a5-9096-4c9a1e62caf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d361135-661a-46a5-9096-4c9a1e62caf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f35da6-5f2b-46dd-bf35-8bf4275a2483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:16 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Volume c8ecea41-1ad7-4eb7-bb02-9393c691a71e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8ecea41-1ad7-4eb7-bb02-9393c691a71e', 'volume_size': 1}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:16 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-827542c3-6fc6-4bb1-afda-8c8591a634a6 1073741824" returned: 0 in 0.421s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-827542c3-6fc6-4bb1-afda-8c8591a634a6 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:16 devstack sudo[107107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-827542c3-6fc6-4bb1-afda-8c8591a634a6
Nov 07 02:51:16 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:17 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-827542c3-6fc6-4bb1-afda-8c8591a634a6" returned: 0 in 0.241s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.152s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-71816411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c09e6c-8ac0-43d9-a21e-5231c4754ccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4586c3171824ef3a958a9d459e115b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:14Z,use_quota=True,user_id='ef0c45a577784d8080c13e0e93b4c8cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Creating volume d8c09e6c-8ac0-43d9-a21e-5231c4754ccf {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:17 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d8c09e6c-8ac0-43d9-a21e-5231c4754ccf 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9d0fe1-5db8-41bc-b1c4-aca5a0bd638f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-827542c3-6fc6-4bb1-afda-8c8591a634a6', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:17 devstack sudo[107110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d8c09e6c-8ac0-43d9-a21e-5231c4754ccf 1073741824
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd88caa5-b161-472d-b984-870c36e5985a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:17 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:17 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Volume volume-827542c3-6fc6-4bb1-afda-8c8591a634a6 (827542c3-6fc6-4bb1-afda-8c8591a634a6): created successfully
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd88caa5-b161-472d-b984-870c36e5985a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Flow 'volume_create_manager' (7b0fa650-6e10-4ba9-a684-71d1c4cdf4a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:17 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-6abd6e18-2d97-489e-b151-cb06df4dd255 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Created volume successfully.
Nov 07 02:51:17 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d8c09e6c-8ac0-43d9-a21e-5231c4754ccf 1073741824" returned: 0 in 0.456s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d8c09e6c-8ac0-43d9-a21e-5231c4754ccf {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:17 devstack sudo[107115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d8c09e6c-8ac0-43d9-a21e-5231c4754ccf
Nov 07 02:51:17 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:17 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d8c09e6c-8ac0-43d9-a21e-5231c4754ccf" returned: 0 in 0.250s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.491s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2008515329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6efbe5a9-e157-4eb4-86c3-a6399e53a1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4586c3171824ef3a958a9d459e115b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:14Z,use_quota=True,user_id='ef0c45a577784d8080c13e0e93b4c8cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Creating volume 6efbe5a9-e157-4eb4-86c3-a6399e53a1b2 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:17 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6efbe5a9-e157-4eb4-86c3-a6399e53a1b2 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c984d5da-01bf-42b8-9eff-23c840aeddbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8c09e6c-8ac0-43d9-a21e-5231c4754ccf', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:17 devstack sudo[107118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6efbe5a9-e157-4eb4-86c3-a6399e53a1b2 1073741824
Nov 07 02:51:17 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7da4c89-1e70-4cdc-aa3d-59f96d181489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:17 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Volume volume-d8c09e6c-8ac0-43d9-a21e-5231c4754ccf (d8c09e6c-8ac0-43d9-a21e-5231c4754ccf): created successfully
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7da4c89-1e70-4cdc-aa3d-59f96d181489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:17 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Flow 'volume_create_manager' (96e97be1-8405-4d02-b3f7-e5946d9af6ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:17 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-11026c4b-dc47-4abd-aa1d-1b06bb6833c6 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Created volume successfully.
Nov 07 02:51:18 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6efbe5a9-e157-4eb4-86c3-a6399e53a1b2 1073741824" returned: 0 in 0.433s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6efbe5a9-e157-4eb4-86c3-a6399e53a1b2 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:18 devstack sudo[107125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6efbe5a9-e157-4eb4-86c3-a6399e53a1b2
Nov 07 02:51:18 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:18 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6efbe5a9-e157-4eb4-86c3-a6399e53a1b2" returned: 0 in 0.248s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.712s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-802099557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38d9036-908f-4e98-aec9-0fa374ab84eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41216a3ae0d4b43b4040043991b94c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:15Z,use_quota=True,user_id='1cf3e3705fbb4a3ca3bd960485bfafe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Creating volume f38d9036-908f-4e98-aec9-0fa374ab84eb {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:18 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f38d9036-908f-4e98-aec9-0fa374ab84eb 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f157af9-c4f2-46f6-a030-d160138bd980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6efbe5a9-e157-4eb4-86c3-a6399e53a1b2', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:18 devstack sudo[107128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f38d9036-908f-4e98-aec9-0fa374ab84eb 1073741824
Nov 07 02:51:18 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9745ab08-3674-4675-b09e-104b883067b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:18 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Volume volume-6efbe5a9-e157-4eb4-86c3-a6399e53a1b2 (6efbe5a9-e157-4eb4-86c3-a6399e53a1b2): created successfully
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9745ab08-3674-4675-b09e-104b883067b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Flow 'volume_create_manager' (6bf5ebb2-6dd1-43e5-a2e8-b8275501482c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:18 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-15082d3b-40ac-4472-86df-2c3eb782d5e2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Created volume successfully.
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-72674051-d513-4cc5-8175-0519c3c7a17b tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "cinder-6efbe5a9-e157-4eb4-86c3-a6399e53a1b2-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-72674051-d513-4cc5-8175-0519c3c7a17b tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-6efbe5a9-e157-4eb4-86c3-a6399e53a1b2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-72674051-d513-4cc5-8175-0519c3c7a17b tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "cinder-quobyte-6efbe5a9-e157-4eb4-86c3-a6399e53a1b2" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-72674051-d513-4cc5-8175-0519c3c7a17b tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-quobyte-6efbe5a9-e157-4eb4-86c3-a6399e53a1b2" acquired by "delete_volume" :: waited 0.018s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[249d3d8c-4180-4b9a-b743-e810bc2637af]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-72674051-d513-4cc5-8175-0519c3c7a17b tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6efbe5a9-e157-4eb4-86c3-a6399e53a1b2 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:19 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f38d9036-908f-4e98-aec9-0fa374ab84eb 1073741824" returned: 0 in 0.453s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:19 devstack sudo[107134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6efbe5a9-e157-4eb4-86c3-a6399e53a1b2
Nov 07 02:51:19 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f38d9036-908f-4e98-aec9-0fa374ab84eb {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:19 devstack sudo[107136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f38d9036-908f-4e98-aec9-0fa374ab84eb
Nov 07 02:51:19 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:19 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-72674051-d513-4cc5-8175-0519c3c7a17b tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6efbe5a9-e157-4eb4-86c3-a6399e53a1b2" returned: 0 in 0.379s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-72674051-d513-4cc5-8175-0519c3c7a17b tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6efbe5a9-e157-4eb4-86c3-a6399e53a1b2 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:19 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f38d9036-908f-4e98-aec9-0fa374ab84eb" returned: 0 in 0.270s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.735s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1751029912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c325643f-d645-4349-94e8-34db6558d626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41216a3ae0d4b43b4040043991b94c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:15Z,use_quota=True,user_id='1cf3e3705fbb4a3ca3bd960485bfafe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Creating volume c325643f-d645-4349-94e8-34db6558d626 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:19 devstack sudo[107142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6efbe5a9-e157-4eb4-86c3-a6399e53a1b2
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:19 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:19 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c325643f-d645-4349-94e8-34db6558d626 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa84ffe-aef5-455d-a626-0cfe5c4cfec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f38d9036-908f-4e98-aec9-0fa374ab84eb', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:19 devstack sudo[107144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c325643f-d645-4349-94e8-34db6558d626 1073741824
Nov 07 02:51:19 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe6c068-fd37-40f8-be05-e208bdcd011f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:19 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Volume volume-f38d9036-908f-4e98-aec9-0fa374ab84eb (f38d9036-908f-4e98-aec9-0fa374ab84eb): created successfully
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe6c068-fd37-40f8-be05-e208bdcd011f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Flow 'volume_create_manager' (010d0e0a-6848-424d-8749-81a36081709f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:19 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-eae9f8b3-eecd-4352-830c-d59a7c3c3b6e tempest-CreateVolumesFromSnapshotTest-239707012 None] Created volume successfully.
Nov 07 02:51:19 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-72674051-d513-4cc5-8175-0519c3c7a17b tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-6efbe5a9-e157-4eb4-86c3-a6399e53a1b2" returned: 0 in 0.301s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-72674051-d513-4cc5-8175-0519c3c7a17b tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-quobyte-6efbe5a9-e157-4eb4-86c3-a6399e53a1b2" released by "delete_volume" :: held 0.721s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-72674051-d513-4cc5-8175-0519c3c7a17b tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Created reservations ['c6c9addb-ae4c-4925-82dd-515cd4822328', '1c90ea46-0cd0-4bac-a5ff-bf3d874b9a60', 'a126f4b8-cb3c-4306-8610-c1adc4831f91', 'ee0be1a1-1f3f-4df8-8a52-0783f7c0e4e6'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-72674051-d513-4cc5-8175-0519c3c7a17b tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-72674051-d513-4cc5-8175-0519c3c7a17b tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-72674051-d513-4cc5-8175-0519c3c7a17b tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-72674051-d513-4cc5-8175-0519c3c7a17b tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-72674051-d513-4cc5-8175-0519c3c7a17b tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-72674051-d513-4cc5-8175-0519c3c7a17b tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:19 devstack sudo[107151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:51:19 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:19 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c325643f-d645-4349-94e8-34db6558d626 1073741824" returned: 0 in 0.466s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c325643f-d645-4349-94e8-34db6558d626 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:19 devstack sudo[107153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c325643f-d645-4349-94e8-34db6558d626
Nov 07 02:51:19 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9509523b-960e-454d-a143-a4f67e37a2a2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "cinder-d8c09e6c-8ac0-43d9-a21e-5231c4754ccf-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:20 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-72674051-d513-4cc5-8175-0519c3c7a17b tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.260s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-72674051-d513-4cc5-8175-0519c3c7a17b tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:20 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-72674051-d513-4cc5-8175-0519c3c7a17b tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Deleted volume successfully.
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9509523b-960e-454d-a143-a4f67e37a2a2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-d8c09e6c-8ac0-43d9-a21e-5231c4754ccf-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-72674051-d513-4cc5-8175-0519c3c7a17b tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-6efbe5a9-e157-4eb4-86c3-a6399e53a1b2-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9509523b-960e-454d-a143-a4f67e37a2a2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "cinder-quobyte-d8c09e6c-8ac0-43d9-a21e-5231c4754ccf" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9509523b-960e-454d-a143-a4f67e37a2a2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-quobyte-d8c09e6c-8ac0-43d9-a21e-5231c4754ccf" acquired by "delete_volume" :: waited 0.019s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[15249812-4822-4da9-9ea5-20c92da0dc1f]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9509523b-960e-454d-a143-a4f67e37a2a2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d8c09e6c-8ac0-43d9-a21e-5231c4754ccf {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:20 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c325643f-d645-4349-94e8-34db6558d626" returned: 0 in 0.305s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ab28ad01-f737-4a01-bf43-8bf5b2034f03 tempest-CinderUnicodeTest-1297222973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.458s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121464c8-9e25-46a3-9777-7ad583c71688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c325643f-d645-4349-94e8-34db6558d626', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d62ff920-33e7-4f1f-bca9-4b666f7fe859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ab28ad01-f737-4a01-bf43-8bf5b2034f03 tempest-CinderUnicodeTest-1297222973 None] Creating offline snapshot e2ccb069-3190-44fc-a656-b6f0bff80000 of volume 3d7c1fb5-61fe-4915-a07d-311aa8d46351 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:51:20 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Volume volume-c325643f-d645-4349-94e8-34db6558d626 (c325643f-d645-4349-94e8-34db6558d626): created successfully
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d62ff920-33e7-4f1f-bca9-4b666f7fe859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Flow 'volume_create_manager' (c665d315-a7b7-4d5a-b06e-d5790aeac38d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[33362c3d-78d1-4abf-b491-25ca2b99fe8b]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ab28ad01-f737-4a01-bf43-8bf5b2034f03 tempest-CinderUnicodeTest-1297222973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:20 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-924eb543-a62f-42dc-9b30-0a1fdb9a9112 tempest-CreateVolumesFromSnapshotTest-239707012 None] Created volume successfully.
Nov 07 02:51:20 devstack sudo[107157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d8c09e6c-8ac0-43d9-a21e-5231c4754ccf
Nov 07 02:51:20 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:20 devstack sudo[107158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351
Nov 07 02:51:20 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:20 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9509523b-960e-454d-a143-a4f67e37a2a2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d8c09e6c-8ac0-43d9-a21e-5231c4754ccf" returned: 0 in 0.427s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9509523b-960e-454d-a143-a4f67e37a2a2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d8c09e6c-8ac0-43d9-a21e-5231c4754ccf {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:20 devstack sudo[107165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d8c09e6c-8ac0-43d9-a21e-5231c4754ccf
Nov 07 02:51:20 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:20 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ab28ad01-f737-4a01-bf43-8bf5b2034f03 tempest-CinderUnicodeTest-1297222973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351" returned: 0 in 0.408s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ab28ad01-f737-4a01-bf43-8bf5b2034f03 tempest-CinderUnicodeTest-1297222973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.e2ccb069-3190-44fc-a656-b6f0bff80000 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:20 devstack sudo[107169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.e2ccb069-3190-44fc-a656-b6f0bff80000 1G
Nov 07 02:51:20 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:20 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9509523b-960e-454d-a143-a4f67e37a2a2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d8c09e6c-8ac0-43d9-a21e-5231c4754ccf" returned: 0 in 0.254s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9509523b-960e-454d-a143-a4f67e37a2a2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-quobyte-d8c09e6c-8ac0-43d9-a21e-5231c4754ccf" released by "delete_volume" :: held 0.720s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-9509523b-960e-454d-a143-a4f67e37a2a2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Created reservations ['161b5fbf-b622-4270-b618-bf006fef2eb5', '3408a031-adac-484a-a633-1b75a0579efc', '63f74b93-4b29-452a-8b45-803174aaa9bb', '44a1d35b-da3f-45ed-816e-f6375bea027d'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9509523b-960e-454d-a143-a4f67e37a2a2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9509523b-960e-454d-a143-a4f67e37a2a2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9509523b-960e-454d-a143-a4f67e37a2a2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9509523b-960e-454d-a143-a4f67e37a2a2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9509523b-960e-454d-a143-a4f67e37a2a2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9509523b-960e-454d-a143-a4f67e37a2a2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:21 devstack sudo[107175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:51:21 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:21 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ab28ad01-f737-4a01-bf43-8bf5b2034f03 tempest-CinderUnicodeTest-1297222973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.e2ccb069-3190-44fc-a656-b6f0bff80000 1G" returned: 0 in 0.414s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ab28ad01-f737-4a01-bf43-8bf5b2034f03 tempest-CinderUnicodeTest-1297222973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.e2ccb069-3190-44fc-a656-b6f0bff80000 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:21 devstack sudo[107177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.e2ccb069-3190-44fc-a656-b6f0bff80000
Nov 07 02:51:21 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-76ecbcbb-cdda-4bf4-bdd4-8e189367cc82 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "cinder-827542c3-6fc6-4bb1-afda-8c8591a634a6-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:21 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9509523b-960e-454d-a143-a4f67e37a2a2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.274s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:21 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-9509523b-960e-454d-a143-a4f67e37a2a2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-76ecbcbb-cdda-4bf4-bdd4-8e189367cc82 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-827542c3-6fc6-4bb1-afda-8c8591a634a6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:21 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-9509523b-960e-454d-a143-a4f67e37a2a2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Deleted volume successfully.
Nov 07 02:51:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9509523b-960e-454d-a143-a4f67e37a2a2 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-d8c09e6c-8ac0-43d9-a21e-5231c4754ccf-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-76ecbcbb-cdda-4bf4-bdd4-8e189367cc82 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "cinder-quobyte-827542c3-6fc6-4bb1-afda-8c8591a634a6" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-76ecbcbb-cdda-4bf4-bdd4-8e189367cc82 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-quobyte-827542c3-6fc6-4bb1-afda-8c8591a634a6" acquired by "delete_volume" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:21 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcb0809-d3e2-40ca-82e0-99d650b882d8]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-76ecbcbb-cdda-4bf4-bdd4-8e189367cc82 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-827542c3-6fc6-4bb1-afda-8c8591a634a6 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:21 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ab28ad01-f737-4a01-bf43-8bf5b2034f03 tempest-CinderUnicodeTest-1297222973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.e2ccb069-3190-44fc-a656-b6f0bff80000" returned: 0 in 0.318s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:21 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-ab28ad01-f737-4a01-bf43-8bf5b2034f03 tempest-CinderUnicodeTest-1297222973 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.e2ccb069-3190-44fc-a656-b6f0bff80000 is being set with open permissions: ugo+rw
Nov 07 02:51:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ab28ad01-f737-4a01-bf43-8bf5b2034f03 tempest-CinderUnicodeTest-1297222973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.e2ccb069-3190-44fc-a656-b6f0bff80000 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:21 devstack sudo[107185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.e2ccb069-3190-44fc-a656-b6f0bff80000
Nov 07 02:51:21 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:21 devstack sudo[107183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-827542c3-6fc6-4bb1-afda-8c8591a634a6
Nov 07 02:51:21 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:21 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ab28ad01-f737-4a01-bf43-8bf5b2034f03 tempest-CinderUnicodeTest-1297222973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.e2ccb069-3190-44fc-a656-b6f0bff80000" returned: 0 in 0.249s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ab28ad01-f737-4a01-bf43-8bf5b2034f03 tempest-CinderUnicodeTest-1297222973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:21 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-76ecbcbb-cdda-4bf4-bdd4-8e189367cc82 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-827542c3-6fc6-4bb1-afda-8c8591a634a6" returned: 0 in 0.365s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:21 devstack sudo[107192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.info
Nov 07 02:51:21 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-76ecbcbb-cdda-4bf4-bdd4-8e189367cc82 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-827542c3-6fc6-4bb1-afda-8c8591a634a6 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:21 devstack sudo[107194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-827542c3-6fc6-4bb1-afda-8c8591a634a6
Nov 07 02:51:21 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:21 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ab28ad01-f737-4a01-bf43-8bf5b2034f03 tempest-CinderUnicodeTest-1297222973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.info" returned: 0 in 0.250s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:21 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-ab28ad01-f737-4a01-bf43-8bf5b2034f03 tempest-CinderUnicodeTest-1297222973 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.info is being set with open permissions: ugo+rw
Nov 07 02:51:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ab28ad01-f737-4a01-bf43-8bf5b2034f03 tempest-CinderUnicodeTest-1297222973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:21 devstack sudo[107198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.info
Nov 07 02:51:21 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:21 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-76ecbcbb-cdda-4bf4-bdd4-8e189367cc82 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-827542c3-6fc6-4bb1-afda-8c8591a634a6" returned: 0 in 0.261s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-76ecbcbb-cdda-4bf4-bdd4-8e189367cc82 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-quobyte-827542c3-6fc6-4bb1-afda-8c8591a634a6" released by "delete_volume" :: held 0.678s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-76ecbcbb-cdda-4bf4-bdd4-8e189367cc82 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Created reservations ['d3a46338-aeb0-46cf-8b7c-abdff8f6698c', '8b3e60c8-9f08-48ba-98de-88c7df01f057', '70e4f9a9-3bbe-4bad-a2b3-4567ccfe73ed', '32a00ae9-c1a4-42ef-bc1e-3f8477baaa1a'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-76ecbcbb-cdda-4bf4-bdd4-8e189367cc82 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-76ecbcbb-cdda-4bf4-bdd4-8e189367cc82 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-76ecbcbb-cdda-4bf4-bdd4-8e189367cc82 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-76ecbcbb-cdda-4bf4-bdd4-8e189367cc82 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-76ecbcbb-cdda-4bf4-bdd4-8e189367cc82 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-76ecbcbb-cdda-4bf4-bdd4-8e189367cc82 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:22 devstack sudo[107200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:51:22 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:22 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ab28ad01-f737-4a01-bf43-8bf5b2034f03 tempest-CinderUnicodeTest-1297222973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.info" returned: 0 in 0.266s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ab28ad01-f737-4a01-bf43-8bf5b2034f03 tempest-CinderUnicodeTest-1297222973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.031s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.427s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1034420960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45bdb638-0514-484c-8b92-a6371d15b983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41216a3ae0d4b43b4040043991b94c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:16Z,use_quota=True,user_id='1cf3e3705fbb4a3ca3bd960485bfafe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Creating volume 45bdb638-0514-484c-8b92-a6371d15b983 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:22 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-45bdb638-0514-484c-8b92-a6371d15b983 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:22 devstack sudo[107203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-45bdb638-0514-484c-8b92-a6371d15b983 1073741824
Nov 07 02:51:22 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:22 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ab28ad01-f737-4a01-bf43-8bf5b2034f03 tempest-CinderUnicodeTest-1297222973 None] Create snapshot completed successfully
Nov 07 02:51:22 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-76ecbcbb-cdda-4bf4-bdd4-8e189367cc82 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.276s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-76ecbcbb-cdda-4bf4-bdd4-8e189367cc82 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:22 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-76ecbcbb-cdda-4bf4-bdd4-8e189367cc82 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Deleted volume successfully.
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-76ecbcbb-cdda-4bf4-bdd4-8e189367cc82 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-827542c3-6fc6-4bb1-afda-8c8591a634a6-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-66de19a2-1253-4e4f-910f-49b41e3cee78 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "cinder-51e5d94e-df72-4cca-96d9-78aafe92a9d3-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-66de19a2-1253-4e4f-910f-49b41e3cee78 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-51e5d94e-df72-4cca-96d9-78aafe92a9d3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-66de19a2-1253-4e4f-910f-49b41e3cee78 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "cinder-quobyte-51e5d94e-df72-4cca-96d9-78aafe92a9d3" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-66de19a2-1253-4e4f-910f-49b41e3cee78 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-quobyte-51e5d94e-df72-4cca-96d9-78aafe92a9d3" acquired by "delete_volume" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[c129e11a-632f-439c-a92f-bc2a8dd908e8]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-66de19a2-1253-4e4f-910f-49b41e3cee78 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-51e5d94e-df72-4cca-96d9-78aafe92a9d3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:22 devstack sudo[107209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-51e5d94e-df72-4cca-96d9-78aafe92a9d3
Nov 07 02:51:22 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b2e1014e-ff69-4652-a89f-09eda2a1fbc5 tempest-CinderUnicodeTest-1297222973 None] Acquiring lock "cinder-e2ccb069-3190-44fc-a656-b6f0bff80000-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:22 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-45bdb638-0514-484c-8b92-a6371d15b983 1073741824" returned: 0 in 0.503s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b2e1014e-ff69-4652-a89f-09eda2a1fbc5 tempest-CinderUnicodeTest-1297222973 None] Lock "cinder-e2ccb069-3190-44fc-a656-b6f0bff80000-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b2e1014e-ff69-4652-a89f-09eda2a1fbc5 tempest-CinderUnicodeTest-1297222973 None] Acquiring lock "cinder-quobyte-3d7c1fb5-61fe-4915-a07d-311aa8d46351" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b2e1014e-ff69-4652-a89f-09eda2a1fbc5 tempest-CinderUnicodeTest-1297222973 None] Lock "cinder-quobyte-3d7c1fb5-61fe-4915-a07d-311aa8d46351" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b2e1014e-ff69-4652-a89f-09eda2a1fbc5 tempest-CinderUnicodeTest-1297222973 None] Acquiring lock "cinder-quobyte-e2ccb069-3190-44fc-a656-b6f0bff80000" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-45bdb638-0514-484c-8b92-a6371d15b983 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b2e1014e-ff69-4652-a89f-09eda2a1fbc5 tempest-CinderUnicodeTest-1297222973 None] Lock "cinder-quobyte-e2ccb069-3190-44fc-a656-b6f0bff80000" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-b2e1014e-ff69-4652-a89f-09eda2a1fbc5 tempest-CinderUnicodeTest-1297222973 None] Deleting offline snapshot e2ccb069-3190-44fc-a656-b6f0bff80000 of volume 3d7c1fb5-61fe-4915-a07d-311aa8d46351 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:51:22 devstack sudo[107211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-45bdb638-0514-484c-8b92-a6371d15b983
Nov 07 02:51:22 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-b2e1014e-ff69-4652-a89f-09eda2a1fbc5 tempest-CinderUnicodeTest-1297222973 None] snapshot_file for this snap is: volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.e2ccb069-3190-44fc-a656-b6f0bff80000 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee34c08-ba5f-4b09-a3bd-773277d4b4e3]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b2e1014e-ff69-4652-a89f-09eda2a1fbc5 tempest-CinderUnicodeTest-1297222973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.e2ccb069-3190-44fc-a656-b6f0bff80000 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:22 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-66de19a2-1253-4e4f-910f-49b41e3cee78 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-51e5d94e-df72-4cca-96d9-78aafe92a9d3" returned: 0 in 0.440s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-66de19a2-1253-4e4f-910f-49b41e3cee78 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-51e5d94e-df72-4cca-96d9-78aafe92a9d3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:23 devstack sudo[107213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.e2ccb069-3190-44fc-a656-b6f0bff80000
Nov 07 02:51:23 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:23 devstack sudo[107217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-51e5d94e-df72-4cca-96d9-78aafe92a9d3
Nov 07 02:51:23 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:23 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-45bdb638-0514-484c-8b92-a6371d15b983" returned: 0 in 0.258s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.019s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae16b068-dd08-4234-b976-0ba09d4a4a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfeba83ae0642e49029bb2f76cb3003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:13Z,use_quota=True,user_id='cb6344ffe0f3470abbad57cd55edaa4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab758e8-f6c8-4c4d-bff8-df32af482460),volume_type_id=8ab758e8-f6c8-4c4d-bff8-df32af482460)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Creating volume ae16b068-dd08-4234-b976-0ba09d4a4a06 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:23 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae16b068-dd08-4234-b976-0ba09d4a4a06 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:23 devstack sudo[107221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae16b068-dd08-4234-b976-0ba09d4a4a06 1073741824
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381eb676-536f-4ebb-8f68-1f92009b73a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45bdb638-0514-484c-8b92-a6371d15b983', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:23 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d21226-56d9-4291-b73b-2d3d0eb431b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:23 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Volume volume-45bdb638-0514-484c-8b92-a6371d15b983 (45bdb638-0514-484c-8b92-a6371d15b983): created successfully
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d21226-56d9-4291-b73b-2d3d0eb431b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Flow 'volume_create_manager' (28c59211-56ef-4f91-8ec9-5e0842a9faed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:23 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-3beb46ab-cb04-46dc-bd25-4da03843ab4f tempest-CreateVolumesFromSnapshotTest-239707012 None] Created volume successfully.
Nov 07 02:51:23 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-66de19a2-1253-4e4f-910f-49b41e3cee78 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-51e5d94e-df72-4cca-96d9-78aafe92a9d3" returned: 0 in 0.267s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:23 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b2e1014e-ff69-4652-a89f-09eda2a1fbc5 tempest-CinderUnicodeTest-1297222973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.e2ccb069-3190-44fc-a656-b6f0bff80000" returned: 0 in 0.390s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-b2e1014e-ff69-4652-a89f-09eda2a1fbc5 tempest-CinderUnicodeTest-1297222973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-66de19a2-1253-4e4f-910f-49b41e3cee78 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-quobyte-51e5d94e-df72-4cca-96d9-78aafe92a9d3" released by "delete_volume" :: held 0.766s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[734ebe58-d6cb-4a6f-830a-7ca21339f166]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b2e1014e-ff69-4652-a89f-09eda2a1fbc5 tempest-CinderUnicodeTest-1297222973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-66de19a2-1253-4e4f-910f-49b41e3cee78 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Created reservations ['aca546f7-56d2-4182-bcae-5834a5e45bb2', '12890b8e-12f8-4642-b0e9-1914182a79f2', 'dca72d56-47ba-49ee-aa5b-12cbed488cd7', '0f06631b-ee32-453d-94c4-bc2d80a98343'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:23 devstack sudo[107228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351
Nov 07 02:51:23 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-66de19a2-1253-4e4f-910f-49b41e3cee78 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-66de19a2-1253-4e4f-910f-49b41e3cee78 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-66de19a2-1253-4e4f-910f-49b41e3cee78 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-66de19a2-1253-4e4f-910f-49b41e3cee78 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-66de19a2-1253-4e4f-910f-49b41e3cee78 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-66de19a2-1253-4e4f-910f-49b41e3cee78 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:23 devstack sudo[107232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:51:23 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:23 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae16b068-dd08-4234-b976-0ba09d4a4a06 1073741824" returned: 0 in 0.490s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0b609486-1b51-4f05-a276-269226b43877 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "cinder-07a3c34e-7684-4233-89fd-702fd01f3bc3-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae16b068-dd08-4234-b976-0ba09d4a4a06 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0b609486-1b51-4f05-a276-269226b43877 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-07a3c34e-7684-4233-89fd-702fd01f3bc3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:23 devstack sudo[107237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae16b068-dd08-4234-b976-0ba09d4a4a06
Nov 07 02:51:23 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0b609486-1b51-4f05-a276-269226b43877 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "cinder-quobyte-07a3c34e-7684-4233-89fd-702fd01f3bc3" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0b609486-1b51-4f05-a276-269226b43877 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-quobyte-07a3c34e-7684-4233-89fd-702fd01f3bc3" acquired by "delete_volume" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:23 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-66de19a2-1253-4e4f-910f-49b41e3cee78 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.341s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-66de19a2-1253-4e4f-910f-49b41e3cee78 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:23 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-66de19a2-1253-4e4f-910f-49b41e3cee78 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Deleted volume successfully.
Nov 07 02:51:23 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b2e1014e-ff69-4652-a89f-09eda2a1fbc5 tempest-CinderUnicodeTest-1297222973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351" returned: 0 in 0.495s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b2e1014e-ff69-4652-a89f-09eda2a1fbc5 tempest-CinderUnicodeTest-1297222973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.e2ccb069-3190-44fc-a656-b6f0bff80000 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[a218d4cd-331b-4d53-9b14-0620861674d4]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0b609486-1b51-4f05-a276-269226b43877 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07a3c34e-7684-4233-89fd-702fd01f3bc3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:23 devstack sudo[107241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.e2ccb069-3190-44fc-a656-b6f0bff80000
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-66de19a2-1253-4e4f-910f-49b41e3cee78 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-51e5d94e-df72-4cca-96d9-78aafe92a9d3-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:23 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:23 devstack sudo[107242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07a3c34e-7684-4233-89fd-702fd01f3bc3
Nov 07 02:51:23 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:23 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae16b068-dd08-4234-b976-0ba09d4a4a06" returned: 0 in 0.343s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.784s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1408793105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e237d4-c6fc-4133-88fe-8eb6fd873d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41216a3ae0d4b43b4040043991b94c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:16Z,use_quota=True,user_id='1cf3e3705fbb4a3ca3bd960485bfafe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Creating volume 92e237d4-c6fc-4133-88fe-8eb6fd873d58 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:24 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-92e237d4-c6fc-4133-88fe-8eb6fd873d58 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:24 devstack sudo[107246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-92e237d4-c6fc-4133-88fe-8eb6fd873d58 1073741824
Nov 07 02:51:24 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Attempting download of 5a7d34a3-4cd4-410d-8a30-d64b13259d4b ((None, [{'url': 'file:///opt/stack/data/glance/images/5a7d34a3-4cd4-410d-8a30-d64b13259d4b', 'metadata': {}}])) to volume ae16b068-dd08-4234-b976-0ba09d4a4a06. {{(pid=87054) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff93edab-b50a-4f06-85a2-997cb2eb3105]: (4, 'raw') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_6n_2wjzd {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:24 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b2e1014e-ff69-4652-a89f-09eda2a1fbc5 tempest-CinderUnicodeTest-1297222973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.e2ccb069-3190-44fc-a656-b6f0bff80000" returned: 0 in 0.425s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b2e1014e-ff69-4652-a89f-09eda2a1fbc5 tempest-CinderUnicodeTest-1297222973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.e2ccb069-3190-44fc-a656-b6f0bff80000 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:24 devstack sudo[107257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.e2ccb069-3190-44fc-a656-b6f0bff80000
Nov 07 02:51:24 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:24 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0b609486-1b51-4f05-a276-269226b43877 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07a3c34e-7684-4233-89fd-702fd01f3bc3" returned: 0 in 0.457s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0b609486-1b51-4f05-a276-269226b43877 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07a3c34e-7684-4233-89fd-702fd01f3bc3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:24 devstack sudo[107253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_6n_2wjzd
Nov 07 02:51:24 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:24 devstack sudo[107259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07a3c34e-7684-4233-89fd-702fd01f3bc3
Nov 07 02:51:24 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:24 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:24 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_6n_2wjzd" returned: 0 in 0.389s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_6n_2wjzd {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:24 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-92e237d4-c6fc-4133-88fe-8eb6fd873d58 1073741824" returned: 0 in 0.533s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0b609486-1b51-4f05-a276-269226b43877 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07a3c34e-7684-4233-89fd-702fd01f3bc3" returned: 0 in 0.281s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:24 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b2e1014e-ff69-4652-a89f-09eda2a1fbc5 tempest-CinderUnicodeTest-1297222973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351.e2ccb069-3190-44fc-a656-b6f0bff80000" returned: 0 in 0.353s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0b609486-1b51-4f05-a276-269226b43877 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-quobyte-07a3c34e-7684-4233-89fd-702fd01f3bc3" released by "delete_volume" :: held 0.819s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b2e1014e-ff69-4652-a89f-09eda2a1fbc5 tempest-CinderUnicodeTest-1297222973 None] Lock "cinder-quobyte-e2ccb069-3190-44fc-a656-b6f0bff80000" released by "_delete_snapshot" :: held 1.797s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b2e1014e-ff69-4652-a89f-09eda2a1fbc5 tempest-CinderUnicodeTest-1297222973 None] Lock "cinder-quobyte-3d7c1fb5-61fe-4915-a07d-311aa8d46351" released by "delete_snapshot" :: held 1.842s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-92e237d4-c6fc-4133-88fe-8eb6fd873d58 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:24 devstack sudo[107270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_6n_2wjzd
Nov 07 02:51:24 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:24 devstack sudo[107272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-92e237d4-c6fc-4133-88fe-8eb6fd873d58
Nov 07 02:51:24 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-0b609486-1b51-4f05-a276-269226b43877 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Created reservations ['0a6e7c32-cb6f-4baa-b16b-6ffb47e8f621', '8cbdb252-1bae-48d5-a43d-4fab1178bd36', 'd530832e-edc6-43f8-a89c-88115d8ecdb4', '0c1f6bd4-2c60-4f72-8c78-dea17edbc10c'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-b2e1014e-ff69-4652-a89f-09eda2a1fbc5 tempest-CinderUnicodeTest-1297222973 None] Created reservations ['ba5042ad-d3b7-47ee-88e4-516b6d9de448', 'bed9e317-68dc-426b-b503-225df7369f7b', '69c9e4e3-8e4c-4049-81cf-99162a9d8fab', 'c698ddd8-d8ca-46f0-926f-0f11ebf76a9e'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0b609486-1b51-4f05-a276-269226b43877 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0b609486-1b51-4f05-a276-269226b43877 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0b609486-1b51-4f05-a276-269226b43877 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0b609486-1b51-4f05-a276-269226b43877 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0b609486-1b51-4f05-a276-269226b43877 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0b609486-1b51-4f05-a276-269226b43877 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:24 devstack sudo[107274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:51:24 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-eaa0c8df-0fc1-4f97-b403-496444a12fdf tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "cinder-26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:24 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b2e1014e-ff69-4652-a89f-09eda2a1fbc5 tempest-CinderUnicodeTest-1297222973 None] Delete snapshot completed successfully.
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-eaa0c8df-0fc1-4f97-b403-496444a12fdf tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b2e1014e-ff69-4652-a89f-09eda2a1fbc5 tempest-CinderUnicodeTest-1297222973 None] Lock "cinder-e2ccb069-3190-44fc-a656-b6f0bff80000-delete_snapshot" released by "delete_snapshot" :: held 2.167s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:24 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_6n_2wjzd" returned: 1 in 0.437s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_6n_2wjzd' failed. Not Retrying. {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:51:24 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-eaa0c8df-0fc1-4f97-b403-496444a12fdf tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "cinder-quobyte-26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-92e237d4-c6fc-4133-88fe-8eb6fd873d58" returned: 0 in 0.333s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7fe56d-2a82-44d3-8604-3ebb446ab9c0]: (4, 'raw') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.366s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1369395949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ecea41-1ad7-4eb7-bb02-9393c691a71e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41216a3ae0d4b43b4040043991b94c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:16Z,use_quota=True,user_id='1cf3e3705fbb4a3ca3bd960485bfafe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Creating volume c8ecea41-1ad7-4eb7-bb02-9393c691a71e {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:25 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c8ecea41-1ad7-4eb7-bb02-9393c691a71e 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:25 devstack sudo[107279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c8ecea41-1ad7-4eb7-bb02-9393c691a71e 1073741824
Nov 07 02:51:25 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-387b1bfc-662d-4233-bb49-b8489e808e53 tempest-CinderUnicodeTest-1297222973 None] Acquiring lock "cinder-3d7c1fb5-61fe-4915-a07d-311aa8d46351-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-eaa0c8df-0fc1-4f97-b403-496444a12fdf tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-quobyte-26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b" acquired by "delete_volume" :: waited 0.084s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6eb3bf-c9c9-4787-a9ee-dfc14e700e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e237d4-c6fc-4133-88fe-8eb6fd873d58', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cd197d-0d66-456c-859b-24b7bd9a7ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9d112c-e591-4036-8e61-e0bc2463da00]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-eaa0c8df-0fc1-4f97-b403-496444a12fdf tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-387b1bfc-662d-4233-bb49-b8489e808e53 tempest-CinderUnicodeTest-1297222973 None] Lock "cinder-3d7c1fb5-61fe-4915-a07d-311aa8d46351-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:25 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Volume volume-92e237d4-c6fc-4133-88fe-8eb6fd873d58 (92e237d4-c6fc-4133-88fe-8eb6fd873d58): created successfully
Nov 07 02:51:25 devstack sudo[107280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD
Nov 07 02:51:25 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cd197d-0d66-456c-859b-24b7bd9a7ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Flow 'volume_create_manager' (a0571f2a-561f-4af2-b4d5-f7fb628db743) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:25 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-2eccc0cd-141a-4718-ad40-bce2c844029d tempest-CreateVolumesFromSnapshotTest-239707012 None] Created volume successfully.
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-387b1bfc-662d-4233-bb49-b8489e808e53 tempest-CinderUnicodeTest-1297222973 None] Acquiring lock "cinder-quobyte-3d7c1fb5-61fe-4915-a07d-311aa8d46351" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-387b1bfc-662d-4233-bb49-b8489e808e53 tempest-CinderUnicodeTest-1297222973 None] Lock "cinder-quobyte-3d7c1fb5-61fe-4915-a07d-311aa8d46351" acquired by "delete_volume" :: waited 0.029s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:25 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:25 devstack sudo[107282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b
Nov 07 02:51:25 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0b609486-1b51-4f05-a276-269226b43877 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.529s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-0b609486-1b51-4f05-a276-269226b43877 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:25 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-0b609486-1b51-4f05-a276-269226b43877 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Deleted volume successfully.
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef8bc93-b496-406d-9b6b-6859122e127f]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-387b1bfc-662d-4233-bb49-b8489e808e53 tempest-CinderUnicodeTest-1297222973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0b609486-1b51-4f05-a276-269226b43877 tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-07a3c34e-7684-4233-89fd-702fd01f3bc3-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:25 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD" returned: 0 in 0.423s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:25 devstack sudo[107288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351
Nov 07 02:51:25 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:25 devstack sudo[107292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD
Nov 07 02:51:25 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:25 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c8ecea41-1ad7-4eb7-bb02-9393c691a71e 1073741824" returned: 0 in 0.633s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:25 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-eaa0c8df-0fc1-4f97-b403-496444a12fdf tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b" returned: 0 in 0.536s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-eaa0c8df-0fc1-4f97-b403-496444a12fdf tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:25 devstack sudo[107300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b
Nov 07 02:51:25 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c8ecea41-1ad7-4eb7-bb02-9393c691a71e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:25 devstack sudo[107302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c8ecea41-1ad7-4eb7-bb02-9393c691a71e
Nov 07 02:51:25 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:25 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-387b1bfc-662d-4233-bb49-b8489e808e53 tempest-CinderUnicodeTest-1297222973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351" returned: 0 in 0.467s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-387b1bfc-662d-4233-bb49-b8489e808e53 tempest-CinderUnicodeTest-1297222973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:25 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD" returned: 1 in 0.402s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] 5a7d34a3-4cd4-410d-8a30-d64b13259d4b was raw, converting to qcow2 {{(pid=87054) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 07 02:51:25 devstack sudo[107311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351
Nov 07 02:51:25 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae16b068-dd08-4234-b976-0ba09d4a4a06 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:25 devstack sudo[107313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae16b068-dd08-4234-b976-0ba09d4a4a06
Nov 07 02:51:25 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:25 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-eaa0c8df-0fc1-4f97-b403-496444a12fdf tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b" returned: 0 in 0.290s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:25 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c8ecea41-1ad7-4eb7-bb02-9393c691a71e" returned: 0 in 0.278s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-eaa0c8df-0fc1-4f97-b403-496444a12fdf tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-quobyte-26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b" released by "delete_volume" :: held 0.924s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f35da6-5f2b-46dd-bf35-8bf4275a2483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8ecea41-1ad7-4eb7-bb02-9393c691a71e', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c037d490-dec1-445b-bcf0-1475a44f2e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:26 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Volume volume-c8ecea41-1ad7-4eb7-bb02-9393c691a71e (c8ecea41-1ad7-4eb7-bb02-9393c691a71e): created successfully
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c037d490-dec1-445b-bcf0-1475a44f2e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Flow 'volume_create_manager' (44e41386-a8da-4ebf-b73e-df571e32238c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:26 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-11789974-2fe9-4488-925a-b2382fe874ab tempest-CreateVolumesFromSnapshotTest-239707012 None] Created volume successfully.
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-eaa0c8df-0fc1-4f97-b403-496444a12fdf tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Created reservations ['56244e84-d3a0-4783-8014-6b435f646f7f', 'f68bcd8a-e286-45e3-a2a4-be9705ecffa8', 'f437842a-ff88-4e3f-948c-4f44d55fdc72', '23c82160-8cbe-48ce-8aba-43602df5335f'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:26 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-387b1bfc-662d-4233-bb49-b8489e808e53 tempest-CinderUnicodeTest-1297222973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-3d7c1fb5-61fe-4915-a07d-311aa8d46351" returned: 0 in 0.281s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-387b1bfc-662d-4233-bb49-b8489e808e53 tempest-CinderUnicodeTest-1297222973 None] Lock "cinder-quobyte-3d7c1fb5-61fe-4915-a07d-311aa8d46351" released by "delete_volume" :: held 0.848s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-eaa0c8df-0fc1-4f97-b403-496444a12fdf tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-eaa0c8df-0fc1-4f97-b403-496444a12fdf tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-eaa0c8df-0fc1-4f97-b403-496444a12fdf tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-eaa0c8df-0fc1-4f97-b403-496444a12fdf tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-eaa0c8df-0fc1-4f97-b403-496444a12fdf tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-eaa0c8df-0fc1-4f97-b403-496444a12fdf tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-387b1bfc-662d-4233-bb49-b8489e808e53 tempest-CinderUnicodeTest-1297222973 None] Created reservations ['b6658372-759c-4266-af64-b6a96fcf9a74', '5ff00044-989d-44ad-bfee-19f994356a86', '86c80591-3165-479b-8f9e-3b9f793e7f8d', '635513f0-61e7-4845-ac95-9764da803aa1'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:26 devstack sudo[107321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:51:26 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-387b1bfc-662d-4233-bb49-b8489e808e53 tempest-CinderUnicodeTest-1297222973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-387b1bfc-662d-4233-bb49-b8489e808e53 tempest-CinderUnicodeTest-1297222973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-387b1bfc-662d-4233-bb49-b8489e808e53 tempest-CinderUnicodeTest-1297222973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-387b1bfc-662d-4233-bb49-b8489e808e53 tempest-CinderUnicodeTest-1297222973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-387b1bfc-662d-4233-bb49-b8489e808e53 tempest-CinderUnicodeTest-1297222973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-387b1bfc-662d-4233-bb49-b8489e808e53 tempest-CinderUnicodeTest-1297222973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-226af96b-2ee7-4e42-8d8b-48617c381c9b tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "cinder-c8ecea41-1ad7-4eb7-bb02-9393c691a71e-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:26 devstack sudo[107324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:51:26 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-226af96b-2ee7-4e42-8d8b-48617c381c9b tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-c8ecea41-1ad7-4eb7-bb02-9393c691a71e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-226af96b-2ee7-4e42-8d8b-48617c381c9b tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "cinder-quobyte-c8ecea41-1ad7-4eb7-bb02-9393c691a71e" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-226af96b-2ee7-4e42-8d8b-48617c381c9b tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-quobyte-c8ecea41-1ad7-4eb7-bb02-9393c691a71e" acquired by "delete_volume" :: waited 0.025s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:26 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae16b068-dd08-4234-b976-0ba09d4a4a06" returned: 0 in 0.668s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5a7d34a3-4cd4-410d-8a30-d64b13259d4b_esijylc0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae16b068-dd08-4234-b976-0ba09d4a4a06 {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:51:26 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Converted 0.00 MB image at 0.00 MB/s
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae16b068-dd08-4234-b976-0ba09d4a4a06 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fa0192-9d81-4b44-a0d6-af57d175af16]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-226af96b-2ee7-4e42-8d8b-48617c381c9b tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c8ecea41-1ad7-4eb7-bb02-9393c691a71e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:26 devstack sudo[107327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae16b068-dd08-4234-b976-0ba09d4a4a06 1G
Nov 07 02:51:26 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:26 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-eaa0c8df-0fc1-4f97-b403-496444a12fdf tempest-CreateVolumesFromSourceVolumeTest-763428894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.338s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-eaa0c8df-0fc1-4f97-b403-496444a12fdf tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:26 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-eaa0c8df-0fc1-4f97-b403-496444a12fdf tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Deleted volume successfully.
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-eaa0c8df-0fc1-4f97-b403-496444a12fdf tempest-CreateVolumesFromSourceVolumeTest-763428894 None] Lock "cinder-26d5a2bf-dc02-4d7c-af5f-4a9ffdb03c1b-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:26 devstack sudo[107328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c8ecea41-1ad7-4eb7-bb02-9393c691a71e
Nov 07 02:51:26 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-387b1bfc-662d-4233-bb49-b8489e808e53 tempest-CinderUnicodeTest-1297222973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.306s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-387b1bfc-662d-4233-bb49-b8489e808e53 tempest-CinderUnicodeTest-1297222973 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:26 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:26 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-387b1bfc-662d-4233-bb49-b8489e808e53 tempest-CinderUnicodeTest-1297222973 None] Deleted volume successfully.
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-387b1bfc-662d-4233-bb49-b8489e808e53 tempest-CinderUnicodeTest-1297222973 None] Lock "cinder-3d7c1fb5-61fe-4915-a07d-311aa8d46351-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:26 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae16b068-dd08-4234-b976-0ba09d4a4a06 1G" returned: 0 in 0.343s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Downloaded image 5a7d34a3-4cd4-410d-8a30-d64b13259d4b ((None, [{'url': 'file:///opt/stack/data/glance/images/5a7d34a3-4cd4-410d-8a30-d64b13259d4b', 'metadata': {}}])) to volume ae16b068-dd08-4234-b976-0ba09d4a4a06 successfully. {{(pid=87054) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Temporary image 5a7d34a3-4cd4-410d-8a30-d64b13259d4b for user cb6344ffe0f3470abbad57cd55edaa4f is deleted. {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Marking volume ae16b068-dd08-4234-b976-0ba09d4a4a06 as bootable. {{(pid=87054) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Copying metadata from image 5a7d34a3-4cd4-410d-8a30-d64b13259d4b to ae16b068-dd08-4234-b976-0ba09d4a4a06. {{(pid=87054) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Creating volume glance metadata for volume ae16b068-dd08-4234-b976-0ba09d4a4a06 backed by image 5a7d34a3-4cd4-410d-8a30-d64b13259d4b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5a7d34a3-4cd4-410d-8a30-d64b13259d4b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3b7b2148538769f538840d3f6fefe5dc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87054) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78f3846-687e-49a3-9a29-a34f2dbed823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae16b068-dd08-4234-b976-0ba09d4a4a06', 'volume_size': 1, 'image_id': '5a7d34a3-4cd4-410d-8a30-d64b13259d4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a7d34a3-4cd4-410d-8a30-d64b13259d4b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b7b2148538769f538840d3f6fefe5dc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7cfeba83ae0642e49029bb2f76cb3003', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '44d2d2c1d5b363c6ef8a8bb8e5552058a66b84d7351d70839c479132923b8cc2beacbf70e897fdeec2f8ebc1826eb40317d927821adebc23b8891ec5c3849712', 'id': '5a7d34a3-4cd4-410d-8a30-d64b13259d4b', 'created_at': datetime.datetime(2026, 11, 7, 1, 51, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 51, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a7d34a3-4cd4-410d-8a30-d64b13259d4b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7216ffd7e810>}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9b2c9d-8b7c-43c1-b272-3c913f660646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:26 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-226af96b-2ee7-4e42-8d8b-48617c381c9b tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c8ecea41-1ad7-4eb7-bb02-9393c691a71e" returned: 0 in 0.422s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-226af96b-2ee7-4e42-8d8b-48617c381c9b tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c8ecea41-1ad7-4eb7-bb02-9393c691a71e {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:26 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Volume volume-ae16b068-dd08-4234-b976-0ba09d4a4a06 (ae16b068-dd08-4234-b976-0ba09d4a4a06): created successfully
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9b2c9d-8b7c-43c1-b272-3c913f660646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Flow 'volume_create_manager' (28c6236f-1ca2-4301-9095-a7f31a4d8cca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:26 devstack sudo[107338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c8ecea41-1ad7-4eb7-bb02-9393c691a71e
Nov 07 02:51:26 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:27 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-cea82e0a-81bd-42a6-bc2a-7e19ef173ac6 tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Created volume successfully.
Nov 07 02:51:27 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-226af96b-2ee7-4e42-8d8b-48617c381c9b tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c8ecea41-1ad7-4eb7-bb02-9393c691a71e" returned: 0 in 0.256s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-226af96b-2ee7-4e42-8d8b-48617c381c9b tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-quobyte-c8ecea41-1ad7-4eb7-bb02-9393c691a71e" released by "delete_volume" :: held 0.747s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-226af96b-2ee7-4e42-8d8b-48617c381c9b tempest-CreateVolumesFromSnapshotTest-239707012 None] Created reservations ['5202794c-45c2-41bc-9d16-a2c04cbebb74', '491d8939-1f19-46ea-bb08-1c8e8434eb5b', '9e08be2f-7c57-4618-a88f-73c54e4ef8ff', '9b064f50-abe5-4f35-9fb5-54a068bccd97'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5d273d8c-3c7f-4e2d-b934-726688630362 tempest-CinderUnicodeTest-1297222973 None] Acquiring lock "cinder-a10421fa-7304-4460-824e-83ba65fd2fad-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5d273d8c-3c7f-4e2d-b934-726688630362 tempest-CinderUnicodeTest-1297222973 None] Lock "cinder-a10421fa-7304-4460-824e-83ba65fd2fad-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5d273d8c-3c7f-4e2d-b934-726688630362 tempest-CinderUnicodeTest-1297222973 None] Acquiring lock "cinder-quobyte-a10421fa-7304-4460-824e-83ba65fd2fad" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5d273d8c-3c7f-4e2d-b934-726688630362 tempest-CinderUnicodeTest-1297222973 None] Lock "cinder-quobyte-a10421fa-7304-4460-824e-83ba65fd2fad" acquired by "delete_volume" :: waited 0.028s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-226af96b-2ee7-4e42-8d8b-48617c381c9b tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-226af96b-2ee7-4e42-8d8b-48617c381c9b tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-226af96b-2ee7-4e42-8d8b-48617c381c9b tempest-CreateVolumesFromSnapshotTest-239707012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-226af96b-2ee7-4e42-8d8b-48617c381c9b tempest-CreateVolumesFromSnapshotTest-239707012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-226af96b-2ee7-4e42-8d8b-48617c381c9b tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-226af96b-2ee7-4e42-8d8b-48617c381c9b tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1883b0c-333c-46de-940c-2d1900bda922]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5d273d8c-3c7f-4e2d-b934-726688630362 tempest-CinderUnicodeTest-1297222973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a10421fa-7304-4460-824e-83ba65fd2fad {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:27 devstack sudo[107341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:51:27 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e97077f9-d43d-408c-9ea9-e6e4b9e420fd tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "cinder-92e237d4-c6fc-4133-88fe-8eb6fd873d58-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e97077f9-d43d-408c-9ea9-e6e4b9e420fd tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-92e237d4-c6fc-4133-88fe-8eb6fd873d58-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e97077f9-d43d-408c-9ea9-e6e4b9e420fd tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "cinder-quobyte-92e237d4-c6fc-4133-88fe-8eb6fd873d58" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:27 devstack sudo[107342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a10421fa-7304-4460-824e-83ba65fd2fad
Nov 07 02:51:27 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e97077f9-d43d-408c-9ea9-e6e4b9e420fd tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-quobyte-92e237d4-c6fc-4133-88fe-8eb6fd873d58" acquired by "delete_volume" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[acba88ff-5273-4e46-88f2-14d44964d5bd]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e97077f9-d43d-408c-9ea9-e6e4b9e420fd tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-92e237d4-c6fc-4133-88fe-8eb6fd873d58 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:27 devstack sudo[107345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-92e237d4-c6fc-4133-88fe-8eb6fd873d58
Nov 07 02:51:27 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:27 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-226af96b-2ee7-4e42-8d8b-48617c381c9b tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.376s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-226af96b-2ee7-4e42-8d8b-48617c381c9b tempest-CreateVolumesFromSnapshotTest-239707012 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:27 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-226af96b-2ee7-4e42-8d8b-48617c381c9b tempest-CreateVolumesFromSnapshotTest-239707012 None] Deleted volume successfully.
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-226af96b-2ee7-4e42-8d8b-48617c381c9b tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-c8ecea41-1ad7-4eb7-bb02-9393c691a71e-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7549008a-3773-4483-bb63-b028c77c02ff tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Acquiring lock "cinder-ae16b068-dd08-4234-b976-0ba09d4a4a06-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7549008a-3773-4483-bb63-b028c77c02ff tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Lock "cinder-ae16b068-dd08-4234-b976-0ba09d4a4a06-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:28 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5d273d8c-3c7f-4e2d-b934-726688630362 tempest-CinderUnicodeTest-1297222973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a10421fa-7304-4460-824e-83ba65fd2fad" returned: 0 in 0.546s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5d273d8c-3c7f-4e2d-b934-726688630362 tempest-CinderUnicodeTest-1297222973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a10421fa-7304-4460-824e-83ba65fd2fad {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7549008a-3773-4483-bb63-b028c77c02ff tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Acquiring lock "cinder-quobyte-ae16b068-dd08-4234-b976-0ba09d4a4a06" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:28 devstack sudo[107351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a10421fa-7304-4460-824e-83ba65fd2fad
Nov 07 02:51:28 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7549008a-3773-4483-bb63-b028c77c02ff tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Lock "cinder-quobyte-ae16b068-dd08-4234-b976-0ba09d4a4a06" acquired by "delete_volume" :: waited 0.024s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2cc312-47ed-41bf-b856-81254453bedc]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7549008a-3773-4483-bb63-b028c77c02ff tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae16b068-dd08-4234-b976-0ba09d4a4a06 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:28 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e97077f9-d43d-408c-9ea9-e6e4b9e420fd tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-92e237d4-c6fc-4133-88fe-8eb6fd873d58" returned: 0 in 0.478s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e97077f9-d43d-408c-9ea9-e6e4b9e420fd tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-92e237d4-c6fc-4133-88fe-8eb6fd873d58 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:28 devstack sudo[107358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-92e237d4-c6fc-4133-88fe-8eb6fd873d58
Nov 07 02:51:28 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:28 devstack sudo[107356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae16b068-dd08-4234-b976-0ba09d4a4a06
Nov 07 02:51:28 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:28 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5d273d8c-3c7f-4e2d-b934-726688630362 tempest-CinderUnicodeTest-1297222973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-a10421fa-7304-4460-824e-83ba65fd2fad" returned: 0 in 0.389s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5d273d8c-3c7f-4e2d-b934-726688630362 tempest-CinderUnicodeTest-1297222973 None] Lock "cinder-quobyte-a10421fa-7304-4460-824e-83ba65fd2fad" released by "delete_volume" :: held 1.013s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-5d273d8c-3c7f-4e2d-b934-726688630362 tempest-CinderUnicodeTest-1297222973 None] Created reservations ['70c72dd6-9e4a-46bc-8e8b-86015bb7240d', '03eda5f2-7dba-4ecb-b372-01f006d30eb0', 'f764f469-4c1f-4620-a672-9581dd97699c', '79187e16-1213-470e-a360-ac0d8f5db2a7'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:28 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e97077f9-d43d-408c-9ea9-e6e4b9e420fd tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-92e237d4-c6fc-4133-88fe-8eb6fd873d58" returned: 0 in 0.367s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e97077f9-d43d-408c-9ea9-e6e4b9e420fd tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-quobyte-92e237d4-c6fc-4133-88fe-8eb6fd873d58" released by "delete_volume" :: held 0.910s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5d273d8c-3c7f-4e2d-b934-726688630362 tempest-CinderUnicodeTest-1297222973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5d273d8c-3c7f-4e2d-b934-726688630362 tempest-CinderUnicodeTest-1297222973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5d273d8c-3c7f-4e2d-b934-726688630362 tempest-CinderUnicodeTest-1297222973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5d273d8c-3c7f-4e2d-b934-726688630362 tempest-CinderUnicodeTest-1297222973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5d273d8c-3c7f-4e2d-b934-726688630362 tempest-CinderUnicodeTest-1297222973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:28 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5d273d8c-3c7f-4e2d-b934-726688630362 tempest-CinderUnicodeTest-1297222973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7549008a-3773-4483-bb63-b028c77c02ff tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae16b068-dd08-4234-b976-0ba09d4a4a06" returned: 0 in 0.536s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7549008a-3773-4483-bb63-b028c77c02ff tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae16b068-dd08-4234-b976-0ba09d4a4a06 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:28 devstack sudo[107368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:51:28 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-e97077f9-d43d-408c-9ea9-e6e4b9e420fd tempest-CreateVolumesFromSnapshotTest-239707012 None] Created reservations ['954d87e6-31ea-441d-afee-4617965fc3a7', 'e8728d38-eea7-4018-b6b0-964e024b3555', 'f6ee8613-fc33-4c00-925e-0fa161dc0703', '22014693-0e82-44d6-8042-b350bde80dcb'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:28 devstack sudo[107369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae16b068-dd08-4234-b976-0ba09d4a4a06
Nov 07 02:51:28 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e97077f9-d43d-408c-9ea9-e6e4b9e420fd tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e97077f9-d43d-408c-9ea9-e6e4b9e420fd tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e97077f9-d43d-408c-9ea9-e6e4b9e420fd tempest-CreateVolumesFromSnapshotTest-239707012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e97077f9-d43d-408c-9ea9-e6e4b9e420fd tempest-CreateVolumesFromSnapshotTest-239707012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e97077f9-d43d-408c-9ea9-e6e4b9e420fd tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e97077f9-d43d-408c-9ea9-e6e4b9e420fd tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:28 devstack sudo[107372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:51:28 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:28 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5d273d8c-3c7f-4e2d-b934-726688630362 tempest-CinderUnicodeTest-1297222973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.313s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:28 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-5d273d8c-3c7f-4e2d-b934-726688630362 tempest-CinderUnicodeTest-1297222973 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:28 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-5d273d8c-3c7f-4e2d-b934-726688630362 tempest-CinderUnicodeTest-1297222973 None] Deleted volume successfully.
Nov 07 02:51:29 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5d273d8c-3c7f-4e2d-b934-726688630362 tempest-CinderUnicodeTest-1297222973 None] Lock "cinder-a10421fa-7304-4460-824e-83ba65fd2fad-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:29 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7549008a-3773-4483-bb63-b028c77c02ff tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae16b068-dd08-4234-b976-0ba09d4a4a06" returned: 0 in 0.338s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:29 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7549008a-3773-4483-bb63-b028c77c02ff tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Lock "cinder-quobyte-ae16b068-dd08-4234-b976-0ba09d4a4a06" released by "delete_volume" :: held 0.934s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:29 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-7549008a-3773-4483-bb63-b028c77c02ff tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Created reservations ['ed4d893f-5a48-4d41-9409-0fea3406f168', '003b2949-77e6-4967-be6d-af199bfa70bc', '5e586c6a-112e-4108-bc3f-a1bdedbfcbbe', 'b0f46dca-2294-4f8c-b830-fcf49a3e3c6e'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:29 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e97077f9-d43d-408c-9ea9-e6e4b9e420fd tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.301s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:29 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-e97077f9-d43d-408c-9ea9-e6e4b9e420fd tempest-CreateVolumesFromSnapshotTest-239707012 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:29 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-e97077f9-d43d-408c-9ea9-e6e4b9e420fd tempest-CreateVolumesFromSnapshotTest-239707012 None] Deleted volume successfully.
Nov 07 02:51:29 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e97077f9-d43d-408c-9ea9-e6e4b9e420fd tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-92e237d4-c6fc-4133-88fe-8eb6fd873d58-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7549008a-3773-4483-bb63-b028c77c02ff tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7549008a-3773-4483-bb63-b028c77c02ff tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7549008a-3773-4483-bb63-b028c77c02ff tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7549008a-3773-4483-bb63-b028c77c02ff tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7549008a-3773-4483-bb63-b028c77c02ff tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7549008a-3773-4483-bb63-b028c77c02ff tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:29 devstack sudo[107377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:51:29 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:29 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7549008a-3773-4483-bb63-b028c77c02ff tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.254s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:29 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-7549008a-3773-4483-bb63-b028c77c02ff tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:29 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-7549008a-3773-4483-bb63-b028c77c02ff tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Deleted volume successfully.
Nov 07 02:51:29 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-7549008a-3773-4483-bb63-b028c77c02ff tempest-VolumeAndVolumeTypeFromImageTest-2087847585 None] Lock "cinder-ae16b068-dd08-4234-b976-0ba09d4a4a06-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:29 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-18485b72-6cd6-46ec-bd26-ec766a0ca3be tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "cinder-45bdb638-0514-484c-8b92-a6371d15b983-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:29 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-18485b72-6cd6-46ec-bd26-ec766a0ca3be tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-45bdb638-0514-484c-8b92-a6371d15b983-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:29 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-18485b72-6cd6-46ec-bd26-ec766a0ca3be tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "cinder-quobyte-45bdb638-0514-484c-8b92-a6371d15b983" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:29 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-18485b72-6cd6-46ec-bd26-ec766a0ca3be tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-quobyte-45bdb638-0514-484c-8b92-a6371d15b983" acquired by "delete_volume" :: waited 0.021s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:29 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5a01c5-9540-4b80-9500-ba930e44c8c4]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18485b72-6cd6-46ec-bd26-ec766a0ca3be tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-45bdb638-0514-484c-8b92-a6371d15b983 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:30 devstack sudo[107380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-45bdb638-0514-484c-8b92-a6371d15b983
Nov 07 02:51:30 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:30 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18485b72-6cd6-46ec-bd26-ec766a0ca3be tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-45bdb638-0514-484c-8b92-a6371d15b983" returned: 0 in 0.467s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18485b72-6cd6-46ec-bd26-ec766a0ca3be tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-45bdb638-0514-484c-8b92-a6371d15b983 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:30 devstack sudo[107385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-45bdb638-0514-484c-8b92-a6371d15b983
Nov 07 02:51:30 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:30 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18485b72-6cd6-46ec-bd26-ec766a0ca3be tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-45bdb638-0514-484c-8b92-a6371d15b983" returned: 0 in 0.279s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:30 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-18485b72-6cd6-46ec-bd26-ec766a0ca3be tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-quobyte-45bdb638-0514-484c-8b92-a6371d15b983" released by "delete_volume" :: held 0.805s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:30 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-18485b72-6cd6-46ec-bd26-ec766a0ca3be tempest-CreateVolumesFromSnapshotTest-239707012 None] Created reservations ['b47fb126-03ab-45ef-bb6a-52faab28f0ce', '9ff98ac4-995f-427f-85f3-e664a3543f2b', 'b9b6910f-33d1-43c3-8e9d-287371254ed1', '2439dfb3-1cad-40fe-ba43-26edc76ad753'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-18485b72-6cd6-46ec-bd26-ec766a0ca3be tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-18485b72-6cd6-46ec-bd26-ec766a0ca3be tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-18485b72-6cd6-46ec-bd26-ec766a0ca3be tempest-CreateVolumesFromSnapshotTest-239707012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-18485b72-6cd6-46ec-bd26-ec766a0ca3be tempest-CreateVolumesFromSnapshotTest-239707012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-18485b72-6cd6-46ec-bd26-ec766a0ca3be tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18485b72-6cd6-46ec-bd26-ec766a0ca3be tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:30 devstack sudo[107388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:51:30 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:31 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f1156e23-fa85-4182-b7fb-88054ad3ddad tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "cinder-c325643f-d645-4349-94e8-34db6558d626-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:31 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f1156e23-fa85-4182-b7fb-88054ad3ddad tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-c325643f-d645-4349-94e8-34db6558d626-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:31 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f1156e23-fa85-4182-b7fb-88054ad3ddad tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "cinder-quobyte-c325643f-d645-4349-94e8-34db6558d626" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:31 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f1156e23-fa85-4182-b7fb-88054ad3ddad tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-quobyte-c325643f-d645-4349-94e8-34db6558d626" acquired by "delete_volume" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:31 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[731177be-3717-4074-ae75-a4ea9f7f0d39]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:31 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f1156e23-fa85-4182-b7fb-88054ad3ddad tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c325643f-d645-4349-94e8-34db6558d626 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-18485b72-6cd6-46ec-bd26-ec766a0ca3be tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.446s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:31 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-18485b72-6cd6-46ec-bd26-ec766a0ca3be tempest-CreateVolumesFromSnapshotTest-239707012 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:31 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-18485b72-6cd6-46ec-bd26-ec766a0ca3be tempest-CreateVolumesFromSnapshotTest-239707012 None] Deleted volume successfully.
Nov 07 02:51:31 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-18485b72-6cd6-46ec-bd26-ec766a0ca3be tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-45bdb638-0514-484c-8b92-a6371d15b983-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:31 devstack sudo[107391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c325643f-d645-4349-94e8-34db6558d626
Nov 07 02:51:31 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:31 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f1156e23-fa85-4182-b7fb-88054ad3ddad tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c325643f-d645-4349-94e8-34db6558d626" returned: 0 in 0.438s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f1156e23-fa85-4182-b7fb-88054ad3ddad tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c325643f-d645-4349-94e8-34db6558d626 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:31 devstack sudo[107396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c325643f-d645-4349-94e8-34db6558d626
Nov 07 02:51:31 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:32 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f1156e23-fa85-4182-b7fb-88054ad3ddad tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-c325643f-d645-4349-94e8-34db6558d626" returned: 0 in 0.272s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f1156e23-fa85-4182-b7fb-88054ad3ddad tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-quobyte-c325643f-d645-4349-94e8-34db6558d626" released by "delete_volume" :: held 0.786s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:32 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-f1156e23-fa85-4182-b7fb-88054ad3ddad tempest-CreateVolumesFromSnapshotTest-239707012 None] Created reservations ['c57da2da-b547-407c-9ea7-1281e6fea4bb', '1e6287f7-b7cb-4790-8a91-8a698ce43dd8', 'e53957a7-d07d-4077-9b6a-c812ee36e135', 'c2ab96ab-3455-4e6e-9b18-ef7a64315614'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f1156e23-fa85-4182-b7fb-88054ad3ddad tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f1156e23-fa85-4182-b7fb-88054ad3ddad tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:32 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f1156e23-fa85-4182-b7fb-88054ad3ddad tempest-CreateVolumesFromSnapshotTest-239707012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:32 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f1156e23-fa85-4182-b7fb-88054ad3ddad tempest-CreateVolumesFromSnapshotTest-239707012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f1156e23-fa85-4182-b7fb-88054ad3ddad tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f1156e23-fa85-4182-b7fb-88054ad3ddad tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:32 devstack sudo[107399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:51:32 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f4c91703-9758-4577-a381-170aaaa0d366 tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "cinder-f38d9036-908f-4e98-aec9-0fa374ab84eb-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f4c91703-9758-4577-a381-170aaaa0d366 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-f38d9036-908f-4e98-aec9-0fa374ab84eb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f4c91703-9758-4577-a381-170aaaa0d366 tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "cinder-quobyte-f38d9036-908f-4e98-aec9-0fa374ab84eb" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f4c91703-9758-4577-a381-170aaaa0d366 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-quobyte-f38d9036-908f-4e98-aec9-0fa374ab84eb" acquired by "delete_volume" :: waited 0.032s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:32 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[85977376-5222-48d7-966e-18499599a8c9]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f4c91703-9758-4577-a381-170aaaa0d366 tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f38d9036-908f-4e98-aec9-0fa374ab84eb {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:32 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f1156e23-fa85-4182-b7fb-88054ad3ddad tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.457s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:32 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-f1156e23-fa85-4182-b7fb-88054ad3ddad tempest-CreateVolumesFromSnapshotTest-239707012 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:32 devstack sudo[107401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f38d9036-908f-4e98-aec9-0fa374ab84eb
Nov 07 02:51:32 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:32 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f1156e23-fa85-4182-b7fb-88054ad3ddad tempest-CreateVolumesFromSnapshotTest-239707012 None] Deleted volume successfully.
Nov 07 02:51:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f1156e23-fa85-4182-b7fb-88054ad3ddad tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-c325643f-d645-4349-94e8-34db6558d626-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:33 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f4c91703-9758-4577-a381-170aaaa0d366 tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f38d9036-908f-4e98-aec9-0fa374ab84eb" returned: 0 in 0.475s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f4c91703-9758-4577-a381-170aaaa0d366 tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f38d9036-908f-4e98-aec9-0fa374ab84eb {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:33 devstack sudo[107407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f38d9036-908f-4e98-aec9-0fa374ab84eb
Nov 07 02:51:33 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:33 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f4c91703-9758-4577-a381-170aaaa0d366 tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-f38d9036-908f-4e98-aec9-0fa374ab84eb" returned: 0 in 0.286s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f4c91703-9758-4577-a381-170aaaa0d366 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-quobyte-f38d9036-908f-4e98-aec9-0fa374ab84eb" released by "delete_volume" :: held 0.824s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:33 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-f4c91703-9758-4577-a381-170aaaa0d366 tempest-CreateVolumesFromSnapshotTest-239707012 None] Created reservations ['b8b8e9d4-563a-4a63-b0ab-f9a1a929ff9e', 'ca2f4986-56c9-4d87-8215-91473b1003c1', 'd82ea359-79f8-4f26-8815-00f888b8f147', '7a832a1d-c26b-4f4a-b73f-e5b9371da8e0'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f4c91703-9758-4577-a381-170aaaa0d366 tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f4c91703-9758-4577-a381-170aaaa0d366 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f4c91703-9758-4577-a381-170aaaa0d366 tempest-CreateVolumesFromSnapshotTest-239707012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f4c91703-9758-4577-a381-170aaaa0d366 tempest-CreateVolumesFromSnapshotTest-239707012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f4c91703-9758-4577-a381-170aaaa0d366 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f4c91703-9758-4577-a381-170aaaa0d366 tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:33 devstack sudo[107410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:51:33 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5e49e1ec-80fe-496b-986d-519295cc9d30 tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "cinder-5c1a95f4-2b65-4062-a32a-6af90dd64305-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5e49e1ec-80fe-496b-986d-519295cc9d30 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-5c1a95f4-2b65-4062-a32a-6af90dd64305-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5e49e1ec-80fe-496b-986d-519295cc9d30 tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "cinder-quobyte-e4c67174-d606-4113-b0da-bcbdba679610" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5e49e1ec-80fe-496b-986d-519295cc9d30 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-quobyte-e4c67174-d606-4113-b0da-bcbdba679610" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5e49e1ec-80fe-496b-986d-519295cc9d30 tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "cinder-quobyte-5c1a95f4-2b65-4062-a32a-6af90dd64305" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5e49e1ec-80fe-496b-986d-519295cc9d30 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-quobyte-5c1a95f4-2b65-4062-a32a-6af90dd64305" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-5e49e1ec-80fe-496b-986d-519295cc9d30 tempest-CreateVolumesFromSnapshotTest-239707012 None] Deleting offline snapshot 5c1a95f4-2b65-4062-a32a-6af90dd64305 of volume e4c67174-d606-4113-b0da-bcbdba679610 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:51:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-5e49e1ec-80fe-496b-986d-519295cc9d30 tempest-CreateVolumesFromSnapshotTest-239707012 None] snapshot_file for this snap is: volume-e4c67174-d606-4113-b0da-bcbdba679610.5c1a95f4-2b65-4062-a32a-6af90dd64305 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:51:33 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f4c91703-9758-4577-a381-170aaaa0d366 tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.359s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:33 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-f4c91703-9758-4577-a381-170aaaa0d366 tempest-CreateVolumesFromSnapshotTest-239707012 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:33 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f4c91703-9758-4577-a381-170aaaa0d366 tempest-CreateVolumesFromSnapshotTest-239707012 None] Deleted volume successfully.
Nov 07 02:51:33 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd25ece8-9564-45b0-8542-19072040c194]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5e49e1ec-80fe-496b-986d-519295cc9d30 tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.5c1a95f4-2b65-4062-a32a-6af90dd64305 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f4c91703-9758-4577-a381-170aaaa0d366 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-f38d9036-908f-4e98-aec9-0fa374ab84eb-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:34 devstack sudo[107413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.5c1a95f4-2b65-4062-a32a-6af90dd64305
Nov 07 02:51:34 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:34 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5e49e1ec-80fe-496b-986d-519295cc9d30 tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.5c1a95f4-2b65-4062-a32a-6af90dd64305" returned: 0 in 0.556s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-5e49e1ec-80fe-496b-986d-519295cc9d30 tempest-CreateVolumesFromSnapshotTest-239707012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4c67174-d606-4113-b0da-bcbdba679610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:51:34 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c39e47d-88fb-43f9-b962-1447e8f03142]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5e49e1ec-80fe-496b-986d-519295cc9d30 tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:34 devstack sudo[107421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610
Nov 07 02:51:34 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-fd5e63e1-2089-4a54-b03d-e993602ec59d tempest-ProjectAdminTests-1069735324 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7832832336426, 'free_capacity_gb': 1773.7832832336426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87054) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 07 02:51:34 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5e49e1ec-80fe-496b-986d-519295cc9d30 tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610" returned: 0 in 0.440s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5e49e1ec-80fe-496b-986d-519295cc9d30 tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.5c1a95f4-2b65-4062-a32a-6af90dd64305 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:34 devstack sudo[107426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.5c1a95f4-2b65-4062-a32a-6af90dd64305
Nov 07 02:51:34 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:35 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5e49e1ec-80fe-496b-986d-519295cc9d30 tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.5c1a95f4-2b65-4062-a32a-6af90dd64305" returned: 0 in 0.388s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5e49e1ec-80fe-496b-986d-519295cc9d30 tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.5c1a95f4-2b65-4062-a32a-6af90dd64305 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:35 devstack sudo[107432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.5c1a95f4-2b65-4062-a32a-6af90dd64305
Nov 07 02:51:35 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:35 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5e49e1ec-80fe-496b-986d-519295cc9d30 tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610.5c1a95f4-2b65-4062-a32a-6af90dd64305" returned: 0 in 0.279s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5e49e1ec-80fe-496b-986d-519295cc9d30 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-quobyte-5c1a95f4-2b65-4062-a32a-6af90dd64305" released by "_delete_snapshot" :: held 1.863s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5e49e1ec-80fe-496b-986d-519295cc9d30 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-quobyte-e4c67174-d606-4113-b0da-bcbdba679610" released by "delete_snapshot" :: held 1.895s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:35 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-5e49e1ec-80fe-496b-986d-519295cc9d30 tempest-CreateVolumesFromSnapshotTest-239707012 None] Created reservations ['e5279507-691d-4413-827f-7ed361104523', 'c057d849-bbe4-470a-808a-a296b83b317a', '9a11ce75-bbc4-465f-af79-effc9a6b3c81', '60652758-3ad6-4f9b-b9ea-08bf9ddc86ec'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:35 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-5e49e1ec-80fe-496b-986d-519295cc9d30 tempest-CreateVolumesFromSnapshotTest-239707012 None] Delete snapshot completed successfully.
Nov 07 02:51:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5e49e1ec-80fe-496b-986d-519295cc9d30 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-5c1a95f4-2b65-4062-a32a-6af90dd64305-delete_snapshot" released by "delete_snapshot" :: held 2.064s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dc70287b-a8f1-43ec-a109-f9df722a9629 tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "cinder-e4c67174-d606-4113-b0da-bcbdba679610-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dc70287b-a8f1-43ec-a109-f9df722a9629 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-e4c67174-d606-4113-b0da-bcbdba679610-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dc70287b-a8f1-43ec-a109-f9df722a9629 tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "cinder-quobyte-e4c67174-d606-4113-b0da-bcbdba679610" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dc70287b-a8f1-43ec-a109-f9df722a9629 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-quobyte-e4c67174-d606-4113-b0da-bcbdba679610" acquired by "delete_volume" :: waited 0.019s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:36 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c288ad0-84cc-4c6a-911a-1506a3191c66]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dc70287b-a8f1-43ec-a109-f9df722a9629 tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:36 devstack sudo[107435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610
Nov 07 02:51:36 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:36 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dc70287b-a8f1-43ec-a109-f9df722a9629 tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610" returned: 0 in 0.484s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dc70287b-a8f1-43ec-a109-f9df722a9629 tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:36 devstack sudo[107441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610
Nov 07 02:51:36 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:36 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dc70287b-a8f1-43ec-a109-f9df722a9629 tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e4c67174-d606-4113-b0da-bcbdba679610" returned: 0 in 0.311s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dc70287b-a8f1-43ec-a109-f9df722a9629 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-quobyte-e4c67174-d606-4113-b0da-bcbdba679610" released by "delete_volume" :: held 0.902s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:36 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-dc70287b-a8f1-43ec-a109-f9df722a9629 tempest-CreateVolumesFromSnapshotTest-239707012 None] Created reservations ['b76f010f-4495-404e-a827-710262de0f9d', '53652c75-0612-41a9-927a-a213c327f46c', 'ed428330-c6df-4023-aae9-b857e1f55144', '67e154c8-051d-410c-9260-9b2d4d042bb5'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dc70287b-a8f1-43ec-a109-f9df722a9629 tempest-CreateVolumesFromSnapshotTest-239707012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dc70287b-a8f1-43ec-a109-f9df722a9629 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-dc70287b-a8f1-43ec-a109-f9df722a9629 tempest-CreateVolumesFromSnapshotTest-239707012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-dc70287b-a8f1-43ec-a109-f9df722a9629 tempest-CreateVolumesFromSnapshotTest-239707012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dc70287b-a8f1-43ec-a109-f9df722a9629 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dc70287b-a8f1-43ec-a109-f9df722a9629 tempest-CreateVolumesFromSnapshotTest-239707012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:37 devstack sudo[107444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:51:37 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Flow 'volume_create_manager' (0f744bb2-c820-4069-b5f9-4da3a402e22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:37 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79aad91f-4fd1-41a9-9ca4-e27162842b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dc70287b-a8f1-43ec-a109-f9df722a9629 tempest-CreateVolumesFromSnapshotTest-239707012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.379s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-dc70287b-a8f1-43ec-a109-f9df722a9629 tempest-CreateVolumesFromSnapshotTest-239707012 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79aad91f-4fd1-41a9-9ca4-e27162842b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1508115209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b11d897d-76d7-4513-af23-035518de8226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2a21cffcaf4e60b5d6285d15cc529b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:37Z,use_quota=True,user_id='00882573c9ec4dc4b42b89a523ca60e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da623784-1dd9-4dc4-ac27-3cdc1b533c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da623784-1dd9-4dc4-ac27-3cdc1b533c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (653a3e6b-222d-4809-839f-b20c82356fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (653a3e6b-222d-4809-839f-b20c82356fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b11d897d-76d7-4513-af23-035518de8226', 'volume_name': 'volume-b11d897d-76d7-4513-af23-035518de8226', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b32b296-a9d5-42c5-b171-40b395b19c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b32b296-a9d5-42c5-b171-40b395b19c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (276f149e-9ebb-4518-8777-a6b055c1bb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:37 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Volume b11d897d-76d7-4513-af23-035518de8226: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b11d897d-76d7-4513-af23-035518de8226', 'volume_size': 1}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1508115209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b11d897d-76d7-4513-af23-035518de8226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2a21cffcaf4e60b5d6285d15cc529b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:37Z,use_quota=True,user_id='00882573c9ec4dc4b42b89a523ca60e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Creating volume b11d897d-76d7-4513-af23-035518de8226 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:37 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b11d897d-76d7-4513-af23-035518de8226 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:37 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-dc70287b-a8f1-43ec-a109-f9df722a9629 tempest-CreateVolumesFromSnapshotTest-239707012 None] Deleted volume successfully.
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dc70287b-a8f1-43ec-a109-f9df722a9629 tempest-CreateVolumesFromSnapshotTest-239707012 None] Lock "cinder-e4c67174-d606-4113-b0da-bcbdba679610-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:37 devstack sudo[107447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b11d897d-76d7-4513-af23-035518de8226 1073741824
Nov 07 02:51:37 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Flow 'volume_create_manager' (28a1fdfe-0614-4832-bbaf-2ce7b5b51ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:37 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc341e1-59df-4710-85a4-4aede9da57f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc341e1-59df-4710-85a4-4aede9da57f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1055995958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f16cb6a-e0e2-47c2-87b6-e62fd70b3410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2a21cffcaf4e60b5d6285d15cc529b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:38Z,use_quota=True,user_id='00882573c9ec4dc4b42b89a523ca60e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375c539f-b149-447e-9427-3e1ef56d39fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375c539f-b149-447e-9427-3e1ef56d39fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9397987-1765-4b11-a6ca-abc0ecb389a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9397987-1765-4b11-a6ca-abc0ecb389a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f16cb6a-e0e2-47c2-87b6-e62fd70b3410', 'volume_name': 'volume-0f16cb6a-e0e2-47c2-87b6-e62fd70b3410', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bcc4939-e77f-409e-b3cc-5e73c5534e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bcc4939-e77f-409e-b3cc-5e73c5534e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf58165-a2c8-40de-b274-e089dd094004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:38 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Volume 0f16cb6a-e0e2-47c2-87b6-e62fd70b3410: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f16cb6a-e0e2-47c2-87b6-e62fd70b3410', 'volume_size': 1}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:38 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b11d897d-76d7-4513-af23-035518de8226 1073741824" returned: 0 in 0.806s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b11d897d-76d7-4513-af23-035518de8226 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:38 devstack sudo[107454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b11d897d-76d7-4513-af23-035518de8226
Nov 07 02:51:38 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Flow 'volume_create_manager' (df9e74f4-5c1a-4151-a8a9-a622808ece25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977522dd-6219-4b88-bdf3-b6891211d6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:38 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b11d897d-76d7-4513-af23-035518de8226" returned: 0 in 0.404s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.742s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1055995958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f16cb6a-e0e2-47c2-87b6-e62fd70b3410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2a21cffcaf4e60b5d6285d15cc529b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:38Z,use_quota=True,user_id='00882573c9ec4dc4b42b89a523ca60e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Creating volume 0f16cb6a-e0e2-47c2-87b6-e62fd70b3410 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:38 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0f16cb6a-e0e2-47c2-87b6-e62fd70b3410 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977522dd-6219-4b88-bdf3-b6891211d6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1716291386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b38a5781-1cc6-4791-8d31-8826309a4423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2a21cffcaf4e60b5d6285d15cc529b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:39Z,use_quota=True,user_id='00882573c9ec4dc4b42b89a523ca60e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:38 devstack sudo[107457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0f16cb6a-e0e2-47c2-87b6-e62fd70b3410 1073741824
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85dc56dc-0e6f-4623-8b82-0f0138d5616e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:38 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85dc56dc-0e6f-4623-8b82-0f0138d5616e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000a2452-cb98-4e68-82d3-3dd6e2ca095d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000a2452-cb98-4e68-82d3-3dd6e2ca095d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b38a5781-1cc6-4791-8d31-8826309a4423', 'volume_name': 'volume-b38a5781-1cc6-4791-8d31-8826309a4423', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e74ad6f5-59c5-4725-8c36-1e671fcebc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e74ad6f5-59c5-4725-8c36-1e671fcebc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b28927-147a-422c-9055-2e434507f3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:39 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Volume b38a5781-1cc6-4791-8d31-8826309a4423: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b38a5781-1cc6-4791-8d31-8826309a4423', 'volume_size': 1}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (276f149e-9ebb-4518-8777-a6b055c1bb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b11d897d-76d7-4513-af23-035518de8226', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (766ce71c-b98e-4ca8-958b-07c34f32e08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:39 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Volume volume-b11d897d-76d7-4513-af23-035518de8226 (b11d897d-76d7-4513-af23-035518de8226): created successfully
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (766ce71c-b98e-4ca8-958b-07c34f32e08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Flow 'volume_create_manager' (0f744bb2-c820-4069-b5f9-4da3a402e22d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:39 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-d89d4106-73c1-4ead-800a-627dda705759 tempest-CreateVolumesFromImageTest-329238629 None] Created volume successfully.
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Flow 'volume_create_manager' (fc25ee46-48cc-4390-9f1a-d9d8ac5a39ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b27be11a-4c6a-4bdb-bd4a-ac33e715e816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b27be11a-4c6a-4bdb-bd4a-ac33e715e816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1515690079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5020c5eb-dffc-47e5-835a-42faaf210a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2a21cffcaf4e60b5d6285d15cc529b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:40Z,use_quota=True,user_id='00882573c9ec4dc4b42b89a523ca60e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc37ea1d-8785-4d31-b587-8faec7e2efca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc37ea1d-8785-4d31-b587-8faec7e2efca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b5bdb2-f464-4459-9bc7-578b9686d269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b5bdb2-f464-4459-9bc7-578b9686d269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5020c5eb-dffc-47e5-835a-42faaf210a98', 'volume_name': 'volume-5020c5eb-dffc-47e5-835a-42faaf210a98', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (299f0ce4-e506-4d75-b1c2-a08363f455fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (299f0ce4-e506-4d75-b1c2-a08363f455fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d769e58a-5e6c-48bd-a3cb-65536a409b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:39 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Volume 5020c5eb-dffc-47e5-835a-42faaf210a98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5020c5eb-dffc-47e5-835a-42faaf210a98', 'volume_size': 1}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:39 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0f16cb6a-e0e2-47c2-87b6-e62fd70b3410 1073741824" returned: 0 in 0.950s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Flow 'volume_create_manager' (cf282065-6459-4ea9-beeb-e1a12ddf9a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c341e11b-a79d-4619-ba62-5f1404df8749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c341e11b-a79d-4619-ba62-5f1404df8749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1708627711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90854e8da8b14aa28568e8beba706c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:40Z,use_quota=True,user_id='813ad50b030d4d3fac7f68412673b863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20df630-e729-4bc3-b729-2fd7f4492ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20df630-e729-4bc3-b729-2fd7f4492ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333a7df6-6d33-4d47-afa9-0ceac88991ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333a7df6-6d33-4d47-afa9-0ceac88991ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76', 'volume_name': 'volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91684bd-a648-4e45-ac84-e9716f7dc62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91684bd-a648-4e45-ac84-e9716f7dc62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5def145-b912-4aa3-a52a-42040a7bbcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:39 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Volume 493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76', 'volume_size': 1}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0f16cb6a-e0e2-47c2-87b6-e62fd70b3410 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:39 devstack sudo[107463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0f16cb6a-e0e2-47c2-87b6-e62fd70b3410
Nov 07 02:51:39 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:39 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Flow 'volume_create_manager' (87ffe5c1-59be-41c8-9f97-4407b1da1fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c09352-c70a-4783-b44c-27da2688e18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c09352-c70a-4783-b44c-27da2688e18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2059531154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d35618c-dde8-410c-8440-af65a9f01977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2a21cffcaf4e60b5d6285d15cc529b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:40Z,use_quota=True,user_id='00882573c9ec4dc4b42b89a523ca60e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d745fb-5ecd-4467-8b52-b46c4e05912d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d745fb-5ecd-4467-8b52-b46c4e05912d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd300440-165c-48a6-8d33-793173637bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd300440-165c-48a6-8d33-793173637bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d35618c-dde8-410c-8440-af65a9f01977', 'volume_name': 'volume-7d35618c-dde8-410c-8440-af65a9f01977', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91103fd9-8f41-4137-9fa3-118fc6d096af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91103fd9-8f41-4137-9fa3-118fc6d096af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (317d9579-9e35-42d0-915a-3b39b4bd2336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:40 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Volume 7d35618c-dde8-410c-8440-af65a9f01977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d35618c-dde8-410c-8440-af65a9f01977', 'volume_size': 1}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:40 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0f16cb6a-e0e2-47c2-87b6-e62fd70b3410" returned: 0 in 0.332s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.266s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1716291386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b38a5781-1cc6-4791-8d31-8826309a4423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2a21cffcaf4e60b5d6285d15cc529b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:39Z,use_quota=True,user_id='00882573c9ec4dc4b42b89a523ca60e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Creating volume b38a5781-1cc6-4791-8d31-8826309a4423 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:40 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b38a5781-1cc6-4791-8d31-8826309a4423 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf58165-a2c8-40de-b274-e089dd094004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f16cb6a-e0e2-47c2-87b6-e62fd70b3410', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfcebfb1-7bd4-445b-893b-998ace77289f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:40 devstack sudo[107466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b38a5781-1cc6-4791-8d31-8826309a4423 1073741824
Nov 07 02:51:40 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:40 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Volume volume-0f16cb6a-e0e2-47c2-87b6-e62fd70b3410 (0f16cb6a-e0e2-47c2-87b6-e62fd70b3410): created successfully
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfcebfb1-7bd4-445b-893b-998ace77289f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Flow 'volume_create_manager' (28a1fdfe-0614-4832-bbaf-2ce7b5b51ef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:40 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-92db160f-2b2a-4d1c-9291-ffc08739397d tempest-CreateVolumesFromImageTest-329238629 None] Created volume successfully.
Nov 07 02:51:40 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b38a5781-1cc6-4791-8d31-8826309a4423 1073741824" returned: 0 in 0.525s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:40 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b38a5781-1cc6-4791-8d31-8826309a4423 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:40 devstack sudo[107472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b38a5781-1cc6-4791-8d31-8826309a4423
Nov 07 02:51:40 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:41 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b38a5781-1cc6-4791-8d31-8826309a4423" returned: 0 in 0.251s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.345s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1515690079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5020c5eb-dffc-47e5-835a-42faaf210a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2a21cffcaf4e60b5d6285d15cc529b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:40Z,use_quota=True,user_id='00882573c9ec4dc4b42b89a523ca60e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Creating volume 5020c5eb-dffc-47e5-835a-42faaf210a98 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:41 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5020c5eb-dffc-47e5-835a-42faaf210a98 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b28927-147a-422c-9055-2e434507f3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b38a5781-1cc6-4791-8d31-8826309a4423', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60f1890-f8fb-426a-a9f4-344b66f79d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:41 devstack sudo[107475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5020c5eb-dffc-47e5-835a-42faaf210a98 1073741824
Nov 07 02:51:41 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:41 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Volume volume-b38a5781-1cc6-4791-8d31-8826309a4423 (b38a5781-1cc6-4791-8d31-8826309a4423): created successfully
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60f1890-f8fb-426a-a9f4-344b66f79d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Flow 'volume_create_manager' (df9e74f4-5c1a-4151-a8a9-a622808ece25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:41 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-722b5b84-dcda-4f78-b082-fa70ebf237dc tempest-CreateVolumesFromImageTest-329238629 None] Created volume successfully.
Nov 07 02:51:41 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5020c5eb-dffc-47e5-835a-42faaf210a98 1073741824" returned: 0 in 0.527s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5020c5eb-dffc-47e5-835a-42faaf210a98 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:41 devstack sudo[107481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5020c5eb-dffc-47e5-835a-42faaf210a98
Nov 07 02:51:41 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:41 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5020c5eb-dffc-47e5-835a-42faaf210a98" returned: 0 in 0.265s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.037s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1708627711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90854e8da8b14aa28568e8beba706c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:40Z,use_quota=True,user_id='813ad50b030d4d3fac7f68412673b863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Creating volume 493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:41 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:42 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d769e58a-5e6c-48bd-a3cb-65536a409b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5020c5eb-dffc-47e5-835a-42faaf210a98', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c287ab2-d44f-46a6-ae2b-e8f33758e2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:42 devstack sudo[107486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76 1073741824
Nov 07 02:51:42 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:42 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Volume volume-5020c5eb-dffc-47e5-835a-42faaf210a98 (5020c5eb-dffc-47e5-835a-42faaf210a98): created successfully
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c287ab2-d44f-46a6-ae2b-e8f33758e2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Flow 'volume_create_manager' (fc25ee46-48cc-4390-9f1a-d9d8ac5a39ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:42 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-40991a98-4312-48fa-9473-b38ed90cf7a8 tempest-CreateVolumesFromImageTest-329238629 None] Created volume successfully.
Nov 07 02:51:42 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76 1073741824" returned: 0 in 0.596s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:42 devstack sudo[107492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76
Nov 07 02:51:42 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:42 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76" returned: 0 in 0.253s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.804s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2059531154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d35618c-dde8-410c-8440-af65a9f01977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2a21cffcaf4e60b5d6285d15cc529b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:40Z,use_quota=True,user_id='00882573c9ec4dc4b42b89a523ca60e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Creating volume 7d35618c-dde8-410c-8440-af65a9f01977 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:42 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7d35618c-dde8-410c-8440-af65a9f01977 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5def145-b912-4aa3-a52a-42040a7bbcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832438e6-5bfc-4019-be70-38069ff73ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:42 devstack sudo[107495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7d35618c-dde8-410c-8440-af65a9f01977 1073741824
Nov 07 02:51:42 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:42 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Volume volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76 (493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76): created successfully
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832438e6-5bfc-4019-be70-38069ff73ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Flow 'volume_create_manager' (cf282065-6459-4ea9-beeb-e1a12ddf9a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:42 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-6e1528c2-ced7-43f5-a25f-76fef18e3242 tempest-ProjectMemberTests-1907878748 None] Created volume successfully.
Nov 07 02:51:43 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7d35618c-dde8-410c-8440-af65a9f01977 1073741824" returned: 0 in 0.494s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7d35618c-dde8-410c-8440-af65a9f01977 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:43 devstack sudo[107501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7d35618c-dde8-410c-8440-af65a9f01977
Nov 07 02:51:43 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:43 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7d35618c-dde8-410c-8440-af65a9f01977" returned: 0 in 0.288s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (317d9579-9e35-42d0-915a-3b39b4bd2336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d35618c-dde8-410c-8440-af65a9f01977', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30892eee-5592-49cc-b6e2-6af8898e1168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:43 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Volume volume-7d35618c-dde8-410c-8440-af65a9f01977 (7d35618c-dde8-410c-8440-af65a9f01977): created successfully
Nov 07 02:51:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30892eee-5592-49cc-b6e2-6af8898e1168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Flow 'volume_create_manager' (87ffe5c1-59be-41c8-9f97-4407b1da1fdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:43 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f495b476-ca5f-4193-af94-dfbb86f3c040 tempest-CreateVolumesFromImageTest-329238629 None] Created volume successfully.
Nov 07 02:51:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f2f96dd4-1655-4873-95cb-bb444c1ffa4b tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "cinder-7d35618c-dde8-410c-8440-af65a9f01977-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f2f96dd4-1655-4873-95cb-bb444c1ffa4b tempest-CreateVolumesFromImageTest-329238629 None] Lock "cinder-7d35618c-dde8-410c-8440-af65a9f01977-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f2f96dd4-1655-4873-95cb-bb444c1ffa4b tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "cinder-quobyte-7d35618c-dde8-410c-8440-af65a9f01977" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f2f96dd4-1655-4873-95cb-bb444c1ffa4b tempest-CreateVolumesFromImageTest-329238629 None] Lock "cinder-quobyte-7d35618c-dde8-410c-8440-af65a9f01977" acquired by "delete_volume" :: waited 0.027s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:44 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc845cd-a7de-4c82-ae89-86156171c284]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f2f96dd4-1655-4873-95cb-bb444c1ffa4b tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7d35618c-dde8-410c-8440-af65a9f01977 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:44 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Flow 'volume_create_manager' (5df04c58-3ed0-44f5-8d05-1174b427defc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0aca45e-bf42-43d8-a83f-a46ef722aef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0aca45e-bf42-43d8-a83f-a46ef722aef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4d960e-8f20-44be-a6f4-7a60f6237244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54eec87f057a478fb2e47dc9db512907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:45Z,use_quota=True,user_id='d36d8405e37645ba9f78d4197799f3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7960f60-5e8b-4323-9f97-de2978804336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7960f60-5e8b-4323-9f97-de2978804336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6605586a-7f1f-4dae-8bf5-ddd790dc8594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:44 devstack cinder-volume[87054]: DEBUG cinder.image.glance [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Creating Keystone auth plugin from conf {{(pid=87054) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 07 02:51:44 devstack sudo[107504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7d35618c-dde8-410c-8440-af65a9f01977
Nov 07 02:51:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-791bbb74-bb57-4d7e-bc27-e524f6e80833 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-791bbb74-bb57-4d7e-bc27-e524f6e80833 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:44 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-791bbb74-bb57-4d7e-bc27-e524f6e80833 tempest-ProjectMemberTests-1907878748 None] Creating offline snapshot bd8d7825-beec-4261-aacc-64b0a1e837fd of volume 493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:51:44 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2f79d1-631c-4f73-8da3-aeb11ac429a4]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-791bbb74-bb57-4d7e-bc27-e524f6e80833 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:44 devstack sudo[107506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76
Nov 07 02:51:44 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6605586a-7f1f-4dae-8bf5-ddd790dc8594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2a4d960e-8f20-44be-a6f4-7a60f6237244', 'volume_name': 'volume-2a4d960e-8f20-44be-a6f4-7a60f6237244', 'volume_size': 1, 'image_id': 'b10a4927-9d96-4bdf-a4f0-8984bc016ecd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b10a4927-9d96-4bdf-a4f0-8984bc016ecd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c9e7ca4e417242cf255acff60c4a315e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54eec87f057a478fb2e47dc9db512907', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f83d346c1d0a2682dbca3d2865790e1504e1dfbce1b715f420a15021b44e6dce1edb59593df5514410810c395c831721a04cde2cf87ac3e708105a85ac3a1514', 'id': 'b10a4927-9d96-4bdf-a4f0-8984bc016ecd', 'created_at': datetime.datetime(2026, 11, 7, 1, 51, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 51, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b10a4927-9d96-4bdf-a4f0-8984bc016ecd/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7216ffc8d6d0>}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (748b23d4-204a-42af-a0ab-c926108d8f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:44 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (748b23d4-204a-42af-a0ab-c926108d8f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d076ac-018f-4e45-83b8-a71754c7504b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:45 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Volume 2a4d960e-8f20-44be-a6f4-7a60f6237244: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2a4d960e-8f20-44be-a6f4-7a60f6237244', 'volume_size': 1, 'image_id': 'b10a4927-9d96-4bdf-a4f0-8984bc016ecd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b10a4927-9d96-4bdf-a4f0-8984bc016ecd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c9e7ca4e417242cf255acff60c4a315e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54eec87f057a478fb2e47dc9db512907', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f83d346c1d0a2682dbca3d2865790e1504e1dfbce1b715f420a15021b44e6dce1edb59593df5514410810c395c831721a04cde2cf87ac3e708105a85ac3a1514', 'id': 'b10a4927-9d96-4bdf-a4f0-8984bc016ecd', 'created_at': datetime.datetime(2026, 11, 7, 1, 51, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 51, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b10a4927-9d96-4bdf-a4f0-8984bc016ecd/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7216ffc8d6d0>}
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Trying to clone 2a4d960e-8f20-44be-a6f4-7a60f6237244 from image b10a4927-9d96-4bdf-a4f0-8984bc016ecd at location (None, [{'url': 'file:///opt/stack/data/glance/images/b10a4927-9d96-4bdf-a4f0-8984bc016ecd', 'metadata': {}}]). {{(pid=87054) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 07 02:51:45 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f2f96dd4-1655-4873-95cb-bb444c1ffa4b tempest-CreateVolumesFromImageTest-329238629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7d35618c-dde8-410c-8440-af65a9f01977" returned: 0 in 0.429s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f2f96dd4-1655-4873-95cb-bb444c1ffa4b tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7d35618c-dde8-410c-8440-af65a9f01977 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:45 devstack sudo[107512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7d35618c-dde8-410c-8440-af65a9f01977
Nov 07 02:51:45 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 07 02:51:45 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Image download 0.00 MB at 0.00 MB/s
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b3c47f-8abf-4618-b9b9-42b39c3d254b]: (4, 'raw') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:45 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-791bbb74-bb57-4d7e-bc27-e524f6e80833 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76" returned: 0 in 0.432s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-791bbb74-bb57-4d7e-bc27-e524f6e80833 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.bd8d7825-beec-4261-aacc-64b0a1e837fd 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:45 devstack sudo[107514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD
Nov 07 02:51:45 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:45 devstack sudo[107520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.bd8d7825-beec-4261-aacc-64b0a1e837fd 1G
Nov 07 02:51:45 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:45 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f2f96dd4-1655-4873-95cb-bb444c1ffa4b tempest-CreateVolumesFromImageTest-329238629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-7d35618c-dde8-410c-8440-af65a9f01977" returned: 0 in 0.341s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f2f96dd4-1655-4873-95cb-bb444c1ffa4b tempest-CreateVolumesFromImageTest-329238629 None] Lock "cinder-quobyte-7d35618c-dde8-410c-8440-af65a9f01977" released by "delete_volume" :: held 0.837s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-f2f96dd4-1655-4873-95cb-bb444c1ffa4b tempest-CreateVolumesFromImageTest-329238629 None] Created reservations ['f31abdfc-950e-4508-8a9a-1108348a17e5', '9c8c72da-0c7d-4364-ab72-cc6d3d2be083', '5671e365-73c4-4a9b-8e5f-87cc0276b347', '815ba261-0629-4fbd-997f-2a9956e032ed'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:45 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f2f96dd4-1655-4873-95cb-bb444c1ffa4b tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f2f96dd4-1655-4873-95cb-bb444c1ffa4b tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f2f96dd4-1655-4873-95cb-bb444c1ffa4b tempest-CreateVolumesFromImageTest-329238629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f2f96dd4-1655-4873-95cb-bb444c1ffa4b tempest-CreateVolumesFromImageTest-329238629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f2f96dd4-1655-4873-95cb-bb444c1ffa4b tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f2f96dd4-1655-4873-95cb-bb444c1ffa4b tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:45 devstack sudo[107529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:51:45 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9e5d8e5e-801a-40c3-872a-fe5add94ab34 tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "cinder-5020c5eb-dffc-47e5-835a-42faaf210a98-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9e5d8e5e-801a-40c3-872a-fe5add94ab34 tempest-CreateVolumesFromImageTest-329238629 None] Lock "cinder-5020c5eb-dffc-47e5-835a-42faaf210a98-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:45 devstack sudo[107526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD
Nov 07 02:51:45 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9e5d8e5e-801a-40c3-872a-fe5add94ab34 tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "cinder-quobyte-5020c5eb-dffc-47e5-835a-42faaf210a98" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9e5d8e5e-801a-40c3-872a-fe5add94ab34 tempest-CreateVolumesFromImageTest-329238629 None] Lock "cinder-quobyte-5020c5eb-dffc-47e5-835a-42faaf210a98" acquired by "delete_volume" :: waited 0.034s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d71f213-bcce-40ce-bff2-480c8f258a93]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e5d8e5e-801a-40c3-872a-fe5add94ab34 tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5020c5eb-dffc-47e5-835a-42faaf210a98 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:45 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f2f96dd4-1655-4873-95cb-bb444c1ffa4b tempest-CreateVolumesFromImageTest-329238629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.340s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:45 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-f2f96dd4-1655-4873-95cb-bb444c1ffa4b tempest-CreateVolumesFromImageTest-329238629 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:45 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f2f96dd4-1655-4873-95cb-bb444c1ffa4b tempest-CreateVolumesFromImageTest-329238629 None] Deleted volume successfully.
Nov 07 02:51:45 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-791bbb74-bb57-4d7e-bc27-e524f6e80833 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.bd8d7825-beec-4261-aacc-64b0a1e837fd 1G" returned: 0 in 0.733s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-791bbb74-bb57-4d7e-bc27-e524f6e80833 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.bd8d7825-beec-4261-aacc-64b0a1e837fd {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:46 devstack sudo[107533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5020c5eb-dffc-47e5-835a-42faaf210a98
Nov 07 02:51:46 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f2f96dd4-1655-4873-95cb-bb444c1ffa4b tempest-CreateVolumesFromImageTest-329238629 None] Lock "cinder-7d35618c-dde8-410c-8440-af65a9f01977-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:46 devstack sudo[107536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.bd8d7825-beec-4261-aacc-64b0a1e837fd
Nov 07 02:51:46 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:46 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD" returned: 1 in 0.509s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD' failed. Not Retrying. {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Temporary image b10a4927-9d96-4bdf-a4f0-8984bc016ecd is fetched for user d36d8405e37645ba9f78d4197799f3bd. {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4a3f23-e9b5-42ad-ad34-3fe81e783f55]: (4, 'raw') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:46 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e5d8e5e-801a-40c3-872a-fe5add94ab34 tempest-CreateVolumesFromImageTest-329238629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5020c5eb-dffc-47e5-835a-42faaf210a98" returned: 0 in 0.438s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e5d8e5e-801a-40c3-872a-fe5add94ab34 tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5020c5eb-dffc-47e5-835a-42faaf210a98 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:46 devstack sudo[107541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD
Nov 07 02:51:46 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:46 devstack sudo[107547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5020c5eb-dffc-47e5-835a-42faaf210a98
Nov 07 02:51:46 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:46 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-791bbb74-bb57-4d7e-bc27-e524f6e80833 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.bd8d7825-beec-4261-aacc-64b0a1e837fd" returned: 0 in 0.402s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:46 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-791bbb74-bb57-4d7e-bc27-e524f6e80833 tempest-ProjectMemberTests-1907878748 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.bd8d7825-beec-4261-aacc-64b0a1e837fd is being set with open permissions: ugo+rw
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-791bbb74-bb57-4d7e-bc27-e524f6e80833 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.bd8d7825-beec-4261-aacc-64b0a1e837fd {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:46 devstack sudo[107552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.bd8d7825-beec-4261-aacc-64b0a1e837fd
Nov 07 02:51:46 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:46 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:46 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e5d8e5e-801a-40c3-872a-fe5add94ab34 tempest-CreateVolumesFromImageTest-329238629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-5020c5eb-dffc-47e5-835a-42faaf210a98" returned: 0 in 0.285s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9e5d8e5e-801a-40c3-872a-fe5add94ab34 tempest-CreateVolumesFromImageTest-329238629 None] Lock "cinder-quobyte-5020c5eb-dffc-47e5-835a-42faaf210a98" released by "delete_volume" :: held 0.796s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:46 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-791bbb74-bb57-4d7e-bc27-e524f6e80833 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.bd8d7825-beec-4261-aacc-64b0a1e837fd" returned: 0 in 0.270s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:46 devstack sudo[107557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD
Nov 07 02:51:46 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-9e5d8e5e-801a-40c3-872a-fe5add94ab34 tempest-CreateVolumesFromImageTest-329238629 None] Created reservations ['fd5352eb-f8e7-477e-a08f-3cdb8f762d50', '623aed41-99c1-4721-81b0-39a796368d03', 'cda06251-11b4-4888-9309-32a984486502', 'e89e50f9-ffa9-44e2-9709-8439a5b52813'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-791bbb74-bb57-4d7e-bc27-e524f6e80833 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:46 devstack sudo[107560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.info
Nov 07 02:51:46 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9e5d8e5e-801a-40c3-872a-fe5add94ab34 tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9e5d8e5e-801a-40c3-872a-fe5add94ab34 tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9e5d8e5e-801a-40c3-872a-fe5add94ab34 tempest-CreateVolumesFromImageTest-329238629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-9e5d8e5e-801a-40c3-872a-fe5add94ab34 tempest-CreateVolumesFromImageTest-329238629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9e5d8e5e-801a-40c3-872a-fe5add94ab34 tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e5d8e5e-801a-40c3-872a-fe5add94ab34 tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:46 devstack sudo[107562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:51:46 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:47 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD" returned: 1 in 0.467s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD' failed. Not Retrying. {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-52dbaf02-f7e1-489c-b835-7ff61cee49a2 tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "cinder-b38a5781-1cc6-4791-8d31-8826309a4423-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-52dbaf02-f7e1-489c-b835-7ff61cee49a2 tempest-CreateVolumesFromImageTest-329238629 None] Lock "cinder-b38a5781-1cc6-4791-8d31-8826309a4423-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:47 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-791bbb74-bb57-4d7e-bc27-e524f6e80833 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.info" returned: 0 in 0.407s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:47 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-791bbb74-bb57-4d7e-bc27-e524f6e80833 tempest-ProjectMemberTests-1907878748 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.info is being set with open permissions: ugo+rw
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-791bbb74-bb57-4d7e-bc27-e524f6e80833 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:47 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9e5d8e5e-801a-40c3-872a-fe5add94ab34 tempest-CreateVolumesFromImageTest-329238629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.370s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-9e5d8e5e-801a-40c3-872a-fe5add94ab34 tempest-CreateVolumesFromImageTest-329238629 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:47 devstack sudo[107569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.info
Nov 07 02:51:47 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:47 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-9e5d8e5e-801a-40c3-872a-fe5add94ab34 tempest-CreateVolumesFromImageTest-329238629 None] Deleted volume successfully.
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-52dbaf02-f7e1-489c-b835-7ff61cee49a2 tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "cinder-quobyte-b38a5781-1cc6-4791-8d31-8826309a4423" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9e5d8e5e-801a-40c3-872a-fe5add94ab34 tempest-CreateVolumesFromImageTest-329238629 None] Lock "cinder-5020c5eb-dffc-47e5-835a-42faaf210a98-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-52dbaf02-f7e1-489c-b835-7ff61cee49a2 tempest-CreateVolumesFromImageTest-329238629 None] Lock "cinder-quobyte-b38a5781-1cc6-4791-8d31-8826309a4423" acquired by "delete_volume" :: waited 0.029s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5e2efc-3ca2-4574-92ef-ace5f0cfca0f]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-52dbaf02-f7e1-489c-b835-7ff61cee49a2 tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b38a5781-1cc6-4791-8d31-8826309a4423 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:47 devstack sudo[107571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b38a5781-1cc6-4791-8d31-8826309a4423
Nov 07 02:51:47 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:47 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-791bbb74-bb57-4d7e-bc27-e524f6e80833 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.info" returned: 0 in 0.301s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-791bbb74-bb57-4d7e-bc27-e524f6e80833 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.685s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.440s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4d960e-8f20-44be-a6f4-7a60f6237244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54eec87f057a478fb2e47dc9db512907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:45Z,use_quota=True,user_id='d36d8405e37645ba9f78d4197799f3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Creating volume 2a4d960e-8f20-44be-a6f4-7a60f6237244 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:47 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2a4d960e-8f20-44be-a6f4-7a60f6237244 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:47 devstack sudo[107574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2a4d960e-8f20-44be-a6f4-7a60f6237244 1073741824
Nov 07 02:51:47 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:47 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-791bbb74-bb57-4d7e-bc27-e524f6e80833 tempest-ProjectMemberTests-1907878748 None] Create snapshot completed successfully
Nov 07 02:51:47 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-52dbaf02-f7e1-489c-b835-7ff61cee49a2 tempest-CreateVolumesFromImageTest-329238629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b38a5781-1cc6-4791-8d31-8826309a4423" returned: 0 in 0.428s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-52dbaf02-f7e1-489c-b835-7ff61cee49a2 tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b38a5781-1cc6-4791-8d31-8826309a4423 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:47 devstack sudo[107579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b38a5781-1cc6-4791-8d31-8826309a4423
Nov 07 02:51:47 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:47 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-52dbaf02-f7e1-489c-b835-7ff61cee49a2 tempest-CreateVolumesFromImageTest-329238629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b38a5781-1cc6-4791-8d31-8826309a4423" returned: 0 in 0.273s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-52dbaf02-f7e1-489c-b835-7ff61cee49a2 tempest-CreateVolumesFromImageTest-329238629 None] Lock "cinder-quobyte-b38a5781-1cc6-4791-8d31-8826309a4423" released by "delete_volume" :: held 0.756s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:48 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2a4d960e-8f20-44be-a6f4-7a60f6237244 1073741824" returned: 0 in 0.528s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-52dbaf02-f7e1-489c-b835-7ff61cee49a2 tempest-CreateVolumesFromImageTest-329238629 None] Created reservations ['0beda231-61c9-4990-bba9-362752de44e9', '714bdf4f-a8c0-4127-bb0b-d00504af2a25', 'f124bbef-bc61-4b75-ad92-14196e1def52', '15eb4eb0-47a2-4a4f-b256-86a9602810d7'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-89ef5db4-03aa-40fd-8969-c25852b62cab tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-bd8d7825-beec-4261-aacc-64b0a1e837fd-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2a4d960e-8f20-44be-a6f4-7a60f6237244 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:48 devstack sudo[107586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2a4d960e-8f20-44be-a6f4-7a60f6237244
Nov 07 02:51:48 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-89ef5db4-03aa-40fd-8969-c25852b62cab tempest-ProjectMemberTests-1907878748 None] Lock "cinder-bd8d7825-beec-4261-aacc-64b0a1e837fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-89ef5db4-03aa-40fd-8969-c25852b62cab tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-89ef5db4-03aa-40fd-8969-c25852b62cab tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-89ef5db4-03aa-40fd-8969-c25852b62cab tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-bd8d7825-beec-4261-aacc-64b0a1e837fd" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-89ef5db4-03aa-40fd-8969-c25852b62cab tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-bd8d7825-beec-4261-aacc-64b0a1e837fd" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-89ef5db4-03aa-40fd-8969-c25852b62cab tempest-ProjectMemberTests-1907878748 None] Deleting offline snapshot bd8d7825-beec-4261-aacc-64b0a1e837fd of volume 493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-89ef5db4-03aa-40fd-8969-c25852b62cab tempest-ProjectMemberTests-1907878748 None] snapshot_file for this snap is: volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.bd8d7825-beec-4261-aacc-64b0a1e837fd {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f88e83f-6a70-473c-97b2-0d66eaa02833]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-89ef5db4-03aa-40fd-8969-c25852b62cab tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.bd8d7825-beec-4261-aacc-64b0a1e837fd {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-52dbaf02-f7e1-489c-b835-7ff61cee49a2 tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-52dbaf02-f7e1-489c-b835-7ff61cee49a2 tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-52dbaf02-f7e1-489c-b835-7ff61cee49a2 tempest-CreateVolumesFromImageTest-329238629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-52dbaf02-f7e1-489c-b835-7ff61cee49a2 tempest-CreateVolumesFromImageTest-329238629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-52dbaf02-f7e1-489c-b835-7ff61cee49a2 tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-52dbaf02-f7e1-489c-b835-7ff61cee49a2 tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dcdd904b-1024-474f-89aa-d31dee284999 tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "cinder-0f16cb6a-e0e2-47c2-87b6-e62fd70b3410-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:48 devstack sudo[107590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:51:48 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dcdd904b-1024-474f-89aa-d31dee284999 tempest-CreateVolumesFromImageTest-329238629 None] Lock "cinder-0f16cb6a-e0e2-47c2-87b6-e62fd70b3410-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:48 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2a4d960e-8f20-44be-a6f4-7a60f6237244" returned: 0 in 0.341s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dcdd904b-1024-474f-89aa-d31dee284999 tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "cinder-quobyte-0f16cb6a-e0e2-47c2-87b6-e62fd70b3410" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Attempting download of b10a4927-9d96-4bdf-a4f0-8984bc016ecd ((None, [{'url': 'file:///opt/stack/data/glance/images/b10a4927-9d96-4bdf-a4f0-8984bc016ecd', 'metadata': {}}])) to volume 2a4d960e-8f20-44be-a6f4-7a60f6237244. {{(pid=87054) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dcdd904b-1024-474f-89aa-d31dee284999 tempest-CreateVolumesFromImageTest-329238629 None] Lock "cinder-quobyte-0f16cb6a-e0e2-47c2-87b6-e62fd70b3410" acquired by "delete_volume" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:48 devstack sudo[107589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.bd8d7825-beec-4261-aacc-64b0a1e837fd
Nov 07 02:51:48 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8095a3-d82f-4523-b0f7-342e6a105b98]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dcdd904b-1024-474f-89aa-d31dee284999 tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0f16cb6a-e0e2-47c2-87b6-e62fd70b3410 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[79256533-a032-4ebd-bf8a-b5b966b2ad18]: (4, 'raw') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b10a4927-9d96-4bdf-a4f0-8984bc016ecd_88ghpzis {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:48 devstack sudo[107594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0f16cb6a-e0e2-47c2-87b6-e62fd70b3410
Nov 07 02:51:48 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:48 devstack sudo[107595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b10a4927-9d96-4bdf-a4f0-8984bc016ecd_88ghpzis
Nov 07 02:51:48 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:48 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-52dbaf02-f7e1-489c-b835-7ff61cee49a2 tempest-CreateVolumesFromImageTest-329238629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.392s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-52dbaf02-f7e1-489c-b835-7ff61cee49a2 tempest-CreateVolumesFromImageTest-329238629 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:48 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-52dbaf02-f7e1-489c-b835-7ff61cee49a2 tempest-CreateVolumesFromImageTest-329238629 None] Deleted volume successfully.
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-52dbaf02-f7e1-489c-b835-7ff61cee49a2 tempest-CreateVolumesFromImageTest-329238629 None] Lock "cinder-b38a5781-1cc6-4791-8d31-8826309a4423-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:48 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-89ef5db4-03aa-40fd-8969-c25852b62cab tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.bd8d7825-beec-4261-aacc-64b0a1e837fd" returned: 0 in 0.640s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-89ef5db4-03aa-40fd-8969-c25852b62cab tempest-ProjectMemberTests-1907878748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[597f0392-fe9b-4927-ba7f-c7a9ae2c4871]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-89ef5db4-03aa-40fd-8969-c25852b62cab tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:48 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dcdd904b-1024-474f-89aa-d31dee284999 tempest-CreateVolumesFromImageTest-329238629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0f16cb6a-e0e2-47c2-87b6-e62fd70b3410" returned: 0 in 0.452s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dcdd904b-1024-474f-89aa-d31dee284999 tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0f16cb6a-e0e2-47c2-87b6-e62fd70b3410 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:49 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b10a4927-9d96-4bdf-a4f0-8984bc016ecd_88ghpzis" returned: 0 in 0.445s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b10a4927-9d96-4bdf-a4f0-8984bc016ecd_88ghpzis {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:49 devstack sudo[107608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0f16cb6a-e0e2-47c2-87b6-e62fd70b3410
Nov 07 02:51:49 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:49 devstack sudo[107607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76
Nov 07 02:51:49 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:49 devstack sudo[107609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b10a4927-9d96-4bdf-a4f0-8984bc016ecd_88ghpzis
Nov 07 02:51:49 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:49 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dcdd904b-1024-474f-89aa-d31dee284999 tempest-CreateVolumesFromImageTest-329238629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-0f16cb6a-e0e2-47c2-87b6-e62fd70b3410" returned: 0 in 0.312s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dcdd904b-1024-474f-89aa-d31dee284999 tempest-CreateVolumesFromImageTest-329238629 None] Lock "cinder-quobyte-0f16cb6a-e0e2-47c2-87b6-e62fd70b3410" released by "delete_volume" :: held 0.835s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-dcdd904b-1024-474f-89aa-d31dee284999 tempest-CreateVolumesFromImageTest-329238629 None] Created reservations ['ce6994ba-42b6-4c43-9677-c38ad65765ab', '6f14d5b8-4b67-4be6-bbd6-11a72bb5c93a', 'd2556859-ad46-40b6-8b47-93188141a595', '0de3a03d-2729-4291-a249-b35791ab21e6'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:49 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:49 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b10a4927-9d96-4bdf-a4f0-8984bc016ecd_88ghpzis" returned: 1 in 0.410s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b10a4927-9d96-4bdf-a4f0-8984bc016ecd_88ghpzis' failed. Not Retrying. {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-89ef5db4-03aa-40fd-8969-c25852b62cab tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76" returned: 0 in 0.452s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-89ef5db4-03aa-40fd-8969-c25852b62cab tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.bd8d7825-beec-4261-aacc-64b0a1e837fd {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[17478c86-2957-4451-9442-d912aac4a924]: (4, 'raw') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:49 devstack sudo[107619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.bd8d7825-beec-4261-aacc-64b0a1e837fd
Nov 07 02:51:49 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dcdd904b-1024-474f-89aa-d31dee284999 tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dcdd904b-1024-474f-89aa-d31dee284999 tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-dcdd904b-1024-474f-89aa-d31dee284999 tempest-CreateVolumesFromImageTest-329238629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-dcdd904b-1024-474f-89aa-d31dee284999 tempest-CreateVolumesFromImageTest-329238629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dcdd904b-1024-474f-89aa-d31dee284999 tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dcdd904b-1024-474f-89aa-d31dee284999 tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:49 devstack sudo[107622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:51:49 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:49 devstack sudo[107620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD
Nov 07 02:51:49 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-4fd679b0-ef97-4a6f-969f-c43fba66ad30 tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "cinder-b11d897d-76d7-4513-af23-035518de8226-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-4fd679b0-ef97-4a6f-969f-c43fba66ad30 tempest-CreateVolumesFromImageTest-329238629 None] Lock "cinder-b11d897d-76d7-4513-af23-035518de8226-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-4fd679b0-ef97-4a6f-969f-c43fba66ad30 tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "cinder-quobyte-b11d897d-76d7-4513-af23-035518de8226" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-4fd679b0-ef97-4a6f-969f-c43fba66ad30 tempest-CreateVolumesFromImageTest-329238629 None] Lock "cinder-quobyte-b11d897d-76d7-4513-af23-035518de8226" acquired by "delete_volume" :: waited 0.028s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f79261-644d-418e-b8cd-5b9ba1a99225]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4fd679b0-ef97-4a6f-969f-c43fba66ad30 tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b11d897d-76d7-4513-af23-035518de8226 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:49 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD" returned: 0 in 0.432s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:49 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dcdd904b-1024-474f-89aa-d31dee284999 tempest-CreateVolumesFromImageTest-329238629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.434s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-dcdd904b-1024-474f-89aa-d31dee284999 tempest-CreateVolumesFromImageTest-329238629 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:49 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-dcdd904b-1024-474f-89aa-d31dee284999 tempest-CreateVolumesFromImageTest-329238629 None] Deleted volume successfully.
Nov 07 02:51:49 devstack sudo[107628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b11d897d-76d7-4513-af23-035518de8226
Nov 07 02:51:49 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:49 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-89ef5db4-03aa-40fd-8969-c25852b62cab tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.bd8d7825-beec-4261-aacc-64b0a1e837fd" returned: 0 in 0.554s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-89ef5db4-03aa-40fd-8969-c25852b62cab tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.bd8d7825-beec-4261-aacc-64b0a1e837fd {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-dcdd904b-1024-474f-89aa-d31dee284999 tempest-CreateVolumesFromImageTest-329238629 None] Lock "cinder-0f16cb6a-e0e2-47c2-87b6-e62fd70b3410-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:50 devstack sudo[107635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.bd8d7825-beec-4261-aacc-64b0a1e837fd
Nov 07 02:51:50 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:50 devstack sudo[107632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD
Nov 07 02:51:50 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:50 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4fd679b0-ef97-4a6f-969f-c43fba66ad30 tempest-CreateVolumesFromImageTest-329238629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b11d897d-76d7-4513-af23-035518de8226" returned: 0 in 0.491s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4fd679b0-ef97-4a6f-969f-c43fba66ad30 tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b11d897d-76d7-4513-af23-035518de8226 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:50 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD" returned: 1 in 0.451s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD' failed. Not Retrying. {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 07 02:51:50 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] b10a4927-9d96-4bdf-a4f0-8984bc016ecd was raw, converting to qcow2 {{(pid=87054) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 07 02:51:50 devstack sudo[107645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b11d897d-76d7-4513-af23-035518de8226
Nov 07 02:51:50 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:50 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2a4d960e-8f20-44be-a6f4-7a60f6237244 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-89ef5db4-03aa-40fd-8969-c25852b62cab tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76.bd8d7825-beec-4261-aacc-64b0a1e837fd" returned: 0 in 0.376s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:50 devstack sudo[107647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2a4d960e-8f20-44be-a6f4-7a60f6237244
Nov 07 02:51:50 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-89ef5db4-03aa-40fd-8969-c25852b62cab tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-bd8d7825-beec-4261-aacc-64b0a1e837fd" released by "_delete_snapshot" :: held 2.229s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-89ef5db4-03aa-40fd-8969-c25852b62cab tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76" released by "delete_snapshot" :: held 2.272s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:50 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-89ef5db4-03aa-40fd-8969-c25852b62cab tempest-ProjectMemberTests-1907878748 None] Created reservations ['e9083e20-7ac0-470d-bc2c-b88322979e92', '6edd1abf-c2a5-4f5c-90a4-4aab2607dc9e', '960ffd09-a167-4ffa-b8b7-8b6a7272b3b0', '0a064b0c-26cb-4526-8620-1b1ae89bd330'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:50 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4fd679b0-ef97-4a6f-969f-c43fba66ad30 tempest-CreateVolumesFromImageTest-329238629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-b11d897d-76d7-4513-af23-035518de8226" returned: 0 in 0.302s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-4fd679b0-ef97-4a6f-969f-c43fba66ad30 tempest-CreateVolumesFromImageTest-329238629 None] Lock "cinder-quobyte-b11d897d-76d7-4513-af23-035518de8226" released by "delete_volume" :: held 0.878s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:50 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-89ef5db4-03aa-40fd-8969-c25852b62cab tempest-ProjectMemberTests-1907878748 None] Delete snapshot completed successfully.
Nov 07 02:51:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-89ef5db4-03aa-40fd-8969-c25852b62cab tempest-ProjectMemberTests-1907878748 None] Lock "cinder-bd8d7825-beec-4261-aacc-64b0a1e837fd-delete_snapshot" released by "delete_snapshot" :: held 2.527s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:50 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-4fd679b0-ef97-4a6f-969f-c43fba66ad30 tempest-CreateVolumesFromImageTest-329238629 None] Created reservations ['ef8ce617-32d2-4b59-b7b9-4245b961aae3', '7fdd0514-3985-46b3-b1c0-3f928bf0b3f2', 'd888ba9c-d7a3-4568-9525-986c78991ca4', 'a30a4956-92d8-488a-809a-be4147524e68'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-4fd679b0-ef97-4a6f-969f-c43fba66ad30 tempest-CreateVolumesFromImageTest-329238629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-4fd679b0-ef97-4a6f-969f-c43fba66ad30 tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:50 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-4fd679b0-ef97-4a6f-969f-c43fba66ad30 tempest-CreateVolumesFromImageTest-329238629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:50 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-4fd679b0-ef97-4a6f-969f-c43fba66ad30 tempest-CreateVolumesFromImageTest-329238629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-4fd679b0-ef97-4a6f-969f-c43fba66ad30 tempest-CreateVolumesFromImageTest-329238629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4fd679b0-ef97-4a6f-969f-c43fba66ad30 tempest-CreateVolumesFromImageTest-329238629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:50 devstack sudo[107654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:51:50 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:51 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2a4d960e-8f20-44be-a6f4-7a60f6237244" returned: 0 in 0.662s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:51 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b10a4927-9d96-4bdf-a4f0-8984bc016ecd__lafzi3odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2a4d960e-8f20-44be-a6f4-7a60f6237244 {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:51:51 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Converted 0.00 MB image at 0.00 MB/s
Nov 07 02:51:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2a4d960e-8f20-44be-a6f4-7a60f6237244 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:51 devstack sudo[107656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2a4d960e-8f20-44be-a6f4-7a60f6237244 1G
Nov 07 02:51:51 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:51 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-4fd679b0-ef97-4a6f-969f-c43fba66ad30 tempest-CreateVolumesFromImageTest-329238629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.292s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:51 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-4fd679b0-ef97-4a6f-969f-c43fba66ad30 tempest-CreateVolumesFromImageTest-329238629 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:51 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-4fd679b0-ef97-4a6f-969f-c43fba66ad30 tempest-CreateVolumesFromImageTest-329238629 None] Deleted volume successfully.
Nov 07 02:51:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-4fd679b0-ef97-4a6f-969f-c43fba66ad30 tempest-CreateVolumesFromImageTest-329238629 None] Lock "cinder-b11d897d-76d7-4513-af23-035518de8226-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e99970dd-19e9-4984-8e1b-9cf4cd8d3338 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e99970dd-19e9-4984-8e1b-9cf4cd8d3338 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e99970dd-19e9-4984-8e1b-9cf4cd8d3338 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:51 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2a4d960e-8f20-44be-a6f4-7a60f6237244 1G" returned: 0 in 0.499s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:51 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Downloaded image b10a4927-9d96-4bdf-a4f0-8984bc016ecd ((None, [{'url': 'file:///opt/stack/data/glance/images/b10a4927-9d96-4bdf-a4f0-8984bc016ecd', 'metadata': {}}])) to volume 2a4d960e-8f20-44be-a6f4-7a60f6237244 successfully. {{(pid=87054) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 07 02:51:51 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Temporary image b10a4927-9d96-4bdf-a4f0-8984bc016ecd for user d36d8405e37645ba9f78d4197799f3bd is deleted. {{(pid=87054) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 07 02:51:51 devstack cinder-volume[87054]: DEBUG cinder.volume.volume_utils [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Marking volume 2a4d960e-8f20-44be-a6f4-7a60f6237244 as bootable. {{(pid=87054) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 07 02:51:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e99970dd-19e9-4984-8e1b-9cf4cd8d3338 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76" acquired by "delete_volume" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:51 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Copying metadata from image b10a4927-9d96-4bdf-a4f0-8984bc016ecd to 2a4d960e-8f20-44be-a6f4-7a60f6237244. {{(pid=87054) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 07 02:51:51 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Creating volume glance metadata for volume 2a4d960e-8f20-44be-a6f4-7a60f6237244 backed by image b10a4927-9d96-4bdf-a4f0-8984bc016ecd with: {'image_id': 'b10a4927-9d96-4bdf-a4f0-8984bc016ecd', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c9e7ca4e417242cf255acff60c4a315e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87054) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 07 02:51:51 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e7a5a3-4d73-4b93-baf2-0d663e94a639]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e99970dd-19e9-4984-8e1b-9cf4cd8d3338 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:51 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d076ac-018f-4e45-83b8-a71754c7504b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a4d960e-8f20-44be-a6f4-7a60f6237244', 'volume_size': 1, 'image_id': 'b10a4927-9d96-4bdf-a4f0-8984bc016ecd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b10a4927-9d96-4bdf-a4f0-8984bc016ecd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c9e7ca4e417242cf255acff60c4a315e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54eec87f057a478fb2e47dc9db512907', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f83d346c1d0a2682dbca3d2865790e1504e1dfbce1b715f420a15021b44e6dce1edb59593df5514410810c395c831721a04cde2cf87ac3e708105a85ac3a1514', 'id': 'b10a4927-9d96-4bdf-a4f0-8984bc016ecd', 'created_at': datetime.datetime(2026, 11, 7, 1, 51, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 7, 1, 51, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b10a4927-9d96-4bdf-a4f0-8984bc016ecd/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7216ffc8d6d0>}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:51 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92df480-9c28-4ada-9dcf-9f670359b1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:51 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Volume volume-2a4d960e-8f20-44be-a6f4-7a60f6237244 (2a4d960e-8f20-44be-a6f4-7a60f6237244): created successfully
Nov 07 02:51:51 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92df480-9c28-4ada-9dcf-9f670359b1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:51 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Flow 'volume_create_manager' (5df04c58-3ed0-44f5-8d05-1174b427defc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:51 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-71dbfe3a-e702-4fd4-a596-1d2c2d5f325c tempest-VolumeImageDependencyTests-17744869 None] Created volume successfully.
Nov 07 02:51:51 devstack sudo[107663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76
Nov 07 02:51:51 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:52 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e99970dd-19e9-4984-8e1b-9cf4cd8d3338 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76" returned: 0 in 0.547s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e99970dd-19e9-4984-8e1b-9cf4cd8d3338 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-bd722d6e-ebf0-4583-90c1-6ef7142441f6 tempest-VolumeImageDependencyTests-17744869 None] Acquiring lock "cinder-2a4d960e-8f20-44be-a6f4-7a60f6237244-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:52 devstack sudo[107669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76
Nov 07 02:51:52 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-bd722d6e-ebf0-4583-90c1-6ef7142441f6 tempest-VolumeImageDependencyTests-17744869 None] Lock "cinder-2a4d960e-8f20-44be-a6f4-7a60f6237244-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-bd722d6e-ebf0-4583-90c1-6ef7142441f6 tempest-VolumeImageDependencyTests-17744869 None] Acquiring lock "cinder-quobyte-2a4d960e-8f20-44be-a6f4-7a60f6237244" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-bd722d6e-ebf0-4583-90c1-6ef7142441f6 tempest-VolumeImageDependencyTests-17744869 None] Lock "cinder-quobyte-2a4d960e-8f20-44be-a6f4-7a60f6237244" acquired by "delete_volume" :: waited 0.033s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:52 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba186df-46a5-4b5b-8aed-3d905f8f105c]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bd722d6e-ebf0-4583-90c1-6ef7142441f6 tempest-VolumeImageDependencyTests-17744869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2a4d960e-8f20-44be-a6f4-7a60f6237244 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:52 devstack sudo[107671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2a4d960e-8f20-44be-a6f4-7a60f6237244
Nov 07 02:51:52 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:52 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e99970dd-19e9-4984-8e1b-9cf4cd8d3338 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76" returned: 0 in 0.429s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e99970dd-19e9-4984-8e1b-9cf4cd8d3338 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76" released by "delete_volume" :: held 1.081s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:52 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-e99970dd-19e9-4984-8e1b-9cf4cd8d3338 tempest-ProjectMemberTests-1907878748 None] Created reservations ['98589aa9-569c-4a74-8724-dfaf782bbc11', 'f59a2720-03ea-4371-98a1-0da532969952', 'fe8b7a3a-be18-4bcf-9b24-2be88fcc6a39', '954b48f8-2c78-4e3e-b3f2-17a615dc660a'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e99970dd-19e9-4984-8e1b-9cf4cd8d3338 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e99970dd-19e9-4984-8e1b-9cf4cd8d3338 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e99970dd-19e9-4984-8e1b-9cf4cd8d3338 tempest-ProjectMemberTests-1907878748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e99970dd-19e9-4984-8e1b-9cf4cd8d3338 tempest-ProjectMemberTests-1907878748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e99970dd-19e9-4984-8e1b-9cf4cd8d3338 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e99970dd-19e9-4984-8e1b-9cf4cd8d3338 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:52 devstack sudo[107676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:51:52 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:52 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bd722d6e-ebf0-4583-90c1-6ef7142441f6 tempest-VolumeImageDependencyTests-17744869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2a4d960e-8f20-44be-a6f4-7a60f6237244" returned: 0 in 0.531s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bd722d6e-ebf0-4583-90c1-6ef7142441f6 tempest-VolumeImageDependencyTests-17744869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2a4d960e-8f20-44be-a6f4-7a60f6237244 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:52 devstack sudo[107680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2a4d960e-8f20-44be-a6f4-7a60f6237244
Nov 07 02:51:52 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:53 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e99970dd-19e9-4984-8e1b-9cf4cd8d3338 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.318s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:53 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-e99970dd-19e9-4984-8e1b-9cf4cd8d3338 tempest-ProjectMemberTests-1907878748 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:53 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-e99970dd-19e9-4984-8e1b-9cf4cd8d3338 tempest-ProjectMemberTests-1907878748 None] Deleted volume successfully.
Nov 07 02:51:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e99970dd-19e9-4984-8e1b-9cf4cd8d3338 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-493305d1-13d0-4b7a-9a1b-5cf2ebbd9c76-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:53 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bd722d6e-ebf0-4583-90c1-6ef7142441f6 tempest-VolumeImageDependencyTests-17744869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2a4d960e-8f20-44be-a6f4-7a60f6237244" returned: 0 in 0.343s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-bd722d6e-ebf0-4583-90c1-6ef7142441f6 tempest-VolumeImageDependencyTests-17744869 None] Lock "cinder-quobyte-2a4d960e-8f20-44be-a6f4-7a60f6237244" released by "delete_volume" :: held 0.954s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:53 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-bd722d6e-ebf0-4583-90c1-6ef7142441f6 tempest-VolumeImageDependencyTests-17744869 None] Created reservations ['a4aa2ef5-dd13-4bcb-b2e4-a100f5491a82', '3230cead-d825-4f73-b963-a1c8514175ca', '7aadb4df-4b74-4dcc-aeb0-24301ae0c928', 'b1adf588-8307-44d6-8234-6275c41d1f6a'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:51:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bd722d6e-ebf0-4583-90c1-6ef7142441f6 tempest-VolumeImageDependencyTests-17744869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bd722d6e-ebf0-4583-90c1-6ef7142441f6 tempest-VolumeImageDependencyTests-17744869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bd722d6e-ebf0-4583-90c1-6ef7142441f6 tempest-VolumeImageDependencyTests-17744869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-bd722d6e-ebf0-4583-90c1-6ef7142441f6 tempest-VolumeImageDependencyTests-17744869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-bd722d6e-ebf0-4583-90c1-6ef7142441f6 tempest-VolumeImageDependencyTests-17744869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bd722d6e-ebf0-4583-90c1-6ef7142441f6 tempest-VolumeImageDependencyTests-17744869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:53 devstack sudo[107684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:51:53 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:53 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-bd722d6e-ebf0-4583-90c1-6ef7142441f6 tempest-VolumeImageDependencyTests-17744869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.278s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:53 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-bd722d6e-ebf0-4583-90c1-6ef7142441f6 tempest-VolumeImageDependencyTests-17744869 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:53 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-bd722d6e-ebf0-4583-90c1-6ef7142441f6 tempest-VolumeImageDependencyTests-17744869 None] Deleted volume successfully.
Nov 07 02:51:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-bd722d6e-ebf0-4583-90c1-6ef7142441f6 tempest-VolumeImageDependencyTests-17744869 None] Lock "cinder-2a4d960e-8f20-44be-a6f4-7a60f6237244-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Flow 'volume_create_manager' (2cc3ed88-abf3-40a9-bc2e-ae8c9859db62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204544fc-1807-4ab7-a130-0abf631cc58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204544fc-1807-4ab7-a130-0abf631cc58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1162493541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc366ec-2e12-4d46-a792-c71053b20e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90854e8da8b14aa28568e8beba706c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:54Z,use_quota=True,user_id='813ad50b030d4d3fac7f68412673b863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32812b35-ca53-4ae2-a86e-7d9fda529b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32812b35-ca53-4ae2-a86e-7d9fda529b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ce253e-7581-435d-bc2a-5024de3aa2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ce253e-7581-435d-bc2a-5024de3aa2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dc366ec-2e12-4d46-a792-c71053b20e46', 'volume_name': 'volume-9dc366ec-2e12-4d46-a792-c71053b20e46', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d29a58dd-68f0-474f-a7bd-6ee8f53c49fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d29a58dd-68f0-474f-a7bd-6ee8f53c49fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e885ada-7704-4935-812a-030067ae79fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:54 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Volume 9dc366ec-2e12-4d46-a792-c71053b20e46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dc366ec-2e12-4d46-a792-c71053b20e46', 'volume_size': 1}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1162493541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc366ec-2e12-4d46-a792-c71053b20e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90854e8da8b14aa28568e8beba706c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:54Z,use_quota=True,user_id='813ad50b030d4d3fac7f68412673b863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Creating volume 9dc366ec-2e12-4d46-a792-c71053b20e46 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:54 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:54 devstack sudo[107687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46 1073741824
Nov 07 02:51:54 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Flow 'volume_create_manager' (40030fff-ba5a-4458-9d70-929f9414363b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc055e7d-f7e3-4ef9-afba-bdfad7416e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:54 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46 1073741824" returned: 0 in 0.651s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc055e7d-f7e3-4ef9-afba-bdfad7416e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-601696349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0d583a-a502-44ba-ab8b-e560c46b9f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='369f1290f16c4e759ba3fd0138d81384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:55Z,use_quota=True,user_id='1170960f37b84801aad8d5201b5fe903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e670dc-8334-4c95-8cfb-762766ec5dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:54 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e670dc-8334-4c95-8cfb-762766ec5dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81063a30-50e5-4602-82bb-f9366f47b8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81063a30-50e5-4602-82bb-f9366f47b8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb0d583a-a502-44ba-ab8b-e560c46b9f8b', 'volume_name': 'volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ef61cc-a2b6-4afe-84cc-c006b9582a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ef61cc-a2b6-4afe-84cc-c006b9582a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745b6d1f-2a49-442d-9265-aac6520c782e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:55 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Volume eb0d583a-a502-44ba-ab8b-e560c46b9f8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b', 'volume_size': 1}
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:55 devstack sudo[107693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46
Nov 07 02:51:55 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:55 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46" returned: 0 in 0.289s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.324s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-601696349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0d583a-a502-44ba-ab8b-e560c46b9f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='369f1290f16c4e759ba3fd0138d81384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:51:55Z,use_quota=True,user_id='1170960f37b84801aad8d5201b5fe903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Creating volume eb0d583a-a502-44ba-ab8b-e560c46b9f8b {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:51:55 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e885ada-7704-4935-812a-030067ae79fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dc366ec-2e12-4d46-a792-c71053b20e46', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:55 devstack sudo[107696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b 1073741824
Nov 07 02:51:55 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ec0327-25f1-4d57-a5b5-cd1cba8a9acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:55 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Volume volume-9dc366ec-2e12-4d46-a792-c71053b20e46 (9dc366ec-2e12-4d46-a792-c71053b20e46): created successfully
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ec0327-25f1-4d57-a5b5-cd1cba8a9acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Flow 'volume_create_manager' (2cc3ed88-abf3-40a9-bc2e-ae8c9859db62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:55 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c2c050c5-8b06-4572-8da6-66ebbcaed900 tempest-ProjectMemberTests-1907878748 None] Created volume successfully.
Nov 07 02:51:56 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b 1073741824" returned: 0 in 0.653s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:56 devstack sudo[107703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b
Nov 07 02:51:56 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:56 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b" returned: 0 in 0.358s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:56 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:51:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:56 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745b6d1f-2a49-442d-9265-aac6520c782e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:56 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c1b03a-6368-47bb-a193-4a8b89adf930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:51:56 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Volume volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b (eb0d583a-a502-44ba-ab8b-e560c46b9f8b): created successfully
Nov 07 02:51:56 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c1b03a-6368-47bb-a193-4a8b89adf930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:51:56 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Flow 'volume_create_manager' (40030fff-ba5a-4458-9d70-929f9414363b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:51:56 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b527659a-c81f-4fdd-ae62-9e39b25eb620 tempest-VolumeDependencyTests-1384010995 None] Created volume successfully.
Nov 07 02:51:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-fcb61214-06de-4d32-880e-a394fa3b4ac2 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-fcb61214-06de-4d32-880e-a394fa3b4ac2 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:56 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-fcb61214-06de-4d32-880e-a394fa3b4ac2 tempest-ProjectMemberTests-1907878748 None] Creating offline snapshot ab51ce91-39ae-4ce4-bbfd-18afb13410d3 of volume 9dc366ec-2e12-4d46-a792-c71053b20e46 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:51:56 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfe5665-210c-48c2-a365-1147e0d8ac17]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fcb61214-06de-4d32-880e-a394fa3b4ac2 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:56 devstack sudo[107706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46
Nov 07 02:51:56 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:57 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fcb61214-06de-4d32-880e-a394fa3b4ac2 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46" returned: 0 in 0.485s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fcb61214-06de-4d32-880e-a394fa3b4ac2 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.ab51ce91-39ae-4ce4-bbfd-18afb13410d3 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:57 devstack sudo[107711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.ab51ce91-39ae-4ce4-bbfd-18afb13410d3 1G
Nov 07 02:51:57 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-64626f38-976e-4e90-81c0-c95d4ffa4be9 tempest-VolumeDependencyTests-1384010995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:57 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fcb61214-06de-4d32-880e-a394fa3b4ac2 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.ab51ce91-39ae-4ce4-bbfd-18afb13410d3 1G" returned: 0 in 0.526s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fcb61214-06de-4d32-880e-a394fa3b4ac2 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc366ec-2e12-4d46-a792-c71053b20e46 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.ab51ce91-39ae-4ce4-bbfd-18afb13410d3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:57 devstack sudo[107717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc366ec-2e12-4d46-a792-c71053b20e46 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.ab51ce91-39ae-4ce4-bbfd-18afb13410d3
Nov 07 02:51:57 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:58 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fcb61214-06de-4d32-880e-a394fa3b4ac2 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc366ec-2e12-4d46-a792-c71053b20e46 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.ab51ce91-39ae-4ce4-bbfd-18afb13410d3" returned: 0 in 0.331s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:58 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-fcb61214-06de-4d32-880e-a394fa3b4ac2 tempest-ProjectMemberTests-1907878748 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.ab51ce91-39ae-4ce4-bbfd-18afb13410d3 is being set with open permissions: ugo+rw
Nov 07 02:51:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fcb61214-06de-4d32-880e-a394fa3b4ac2 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.ab51ce91-39ae-4ce4-bbfd-18afb13410d3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:58 devstack sudo[107723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.ab51ce91-39ae-4ce4-bbfd-18afb13410d3
Nov 07 02:51:58 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:58 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fcb61214-06de-4d32-880e-a394fa3b4ac2 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.ab51ce91-39ae-4ce4-bbfd-18afb13410d3" returned: 0 in 0.299s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:58 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:UPDATE=279,cinder:SELECT=204,cinder:INSERT=79,cinder:DELETE=19 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:51:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fcb61214-06de-4d32-880e-a394fa3b4ac2 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:58 devstack sudo[107727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.info
Nov 07 02:51:58 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:58 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fcb61214-06de-4d32-880e-a394fa3b4ac2 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.info" returned: 0 in 0.283s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:58 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-fcb61214-06de-4d32-880e-a394fa3b4ac2 tempest-ProjectMemberTests-1907878748 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.info is being set with open permissions: ugo+rw
Nov 07 02:51:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fcb61214-06de-4d32-880e-a394fa3b4ac2 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:58 devstack sudo[107730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.info
Nov 07 02:51:58 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:58 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fcb61214-06de-4d32-880e-a394fa3b4ac2 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.info" returned: 0 in 0.266s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-fcb61214-06de-4d32-880e-a394fa3b4ac2 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.315s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-64626f38-976e-4e90-81c0-c95d4ffa4be9 tempest-VolumeDependencyTests-1384010995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.704s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-64626f38-976e-4e90-81c0-c95d4ffa4be9 tempest-VolumeDependencyTests-1384010995 None] Creating offline snapshot 14ec81ef-0a49-4177-9d6f-eed5d9e43b76 of volume eb0d583a-a502-44ba-ab8b-e560c46b9f8b {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:51:59 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-fcb61214-06de-4d32-880e-a394fa3b4ac2 tempest-ProjectMemberTests-1907878748 None] Create snapshot completed successfully
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b8b0e8-8bc4-4fd7-b78f-625a33a82385]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-64626f38-976e-4e90-81c0-c95d4ffa4be9 tempest-VolumeDependencyTests-1384010995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:59 devstack sudo[107733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b
Nov 07 02:51:59 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:59 devstack sudo[107735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:51:59 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:59 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-64626f38-976e-4e90-81c0-c95d4ffa4be9 tempest-VolumeDependencyTests-1384010995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b" returned: 0 in 0.480s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-64626f38-976e-4e90-81c0-c95d4ffa4be9 tempest-VolumeDependencyTests-1384010995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.14ec81ef-0a49-4177-9d6f-eed5d9e43b76 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:51:59 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.364s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 28 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>, <Thread(fd_logger, started daemon 125443282798592)>, <Thread(privsep_reader, started daemon 125443284556288)>, <Thread(tpool_thread_0, started daemon 125443276445376)>, <Thread(tpool_thread_1, started daemon 125443268036288)>, <Thread(tpool_thread_2, started daemon 125443259627200)>, <Thread(tpool_thread_3, started daemon 125443251218112)>, <Thread(tpool_thread_4, started daemon 125443242809024)>, <Thread(tpool_thread_5, started daemon 125443234399936)>, <Thread(tpool_thread_6, started daemon 125443225990848)>, <Thread(tpool_thread_7, started daemon 125443217581760)>, <Thread(tpool_thread_8, started daemon 125443209172672)>, <Thread(tpool_thread_9, started daemon 125443200763584)>, <Thread(tpool_thread_10, started daemon 125443192354496)>, <Thread(tpool_thread_11, started daemon 125443183945408)>, <Thread(tpool_thread_12, started daemon 125443175536320)>, <Thread(tpool_thread_13, started daemon 125443167127232)>, <Thread(tpool_thread_14, started daemon 125443158718144)>, <Thread(tpool_thread_15, started daemon 125443150309056)>, <Thread(tpool_thread_16, started daemon 125443141899968)>, <Thread(tpool_thread_17, started daemon 125443133490880)>, <Thread(tpool_thread_18, started daemon 125443125081792)>, <Thread(tpool_thread_19, started daemon 125443116672704)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:51:59 devstack sudo[107742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.14ec81ef-0a49-4177-9d6f-eed5d9e43b76 1G
Nov 07 02:51:59 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9ef05117-79ab-46a1-a16b-c241e2c5d6ab tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-ab51ce91-39ae-4ce4-bbfd-18afb13410d3-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9ef05117-79ab-46a1-a16b-c241e2c5d6ab tempest-ProjectMemberTests-1907878748 None] Lock "cinder-ab51ce91-39ae-4ce4-bbfd-18afb13410d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9ef05117-79ab-46a1-a16b-c241e2c5d6ab tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-9dc366ec-2e12-4d46-a792-c71053b20e46" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9ef05117-79ab-46a1-a16b-c241e2c5d6ab tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-9dc366ec-2e12-4d46-a792-c71053b20e46" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9ef05117-79ab-46a1-a16b-c241e2c5d6ab tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-ab51ce91-39ae-4ce4-bbfd-18afb13410d3" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9ef05117-79ab-46a1-a16b-c241e2c5d6ab tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-ab51ce91-39ae-4ce4-bbfd-18afb13410d3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-9ef05117-79ab-46a1-a16b-c241e2c5d6ab tempest-ProjectMemberTests-1907878748 None] Deleting offline snapshot ab51ce91-39ae-4ce4-bbfd-18afb13410d3 of volume 9dc366ec-2e12-4d46-a792-c71053b20e46 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-9ef05117-79ab-46a1-a16b-c241e2c5d6ab tempest-ProjectMemberTests-1907878748 None] snapshot_file for this snap is: volume-9dc366ec-2e12-4d46-a792-c71053b20e46.ab51ce91-39ae-4ce4-bbfd-18afb13410d3 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d350c9c-bf31-46ab-937c-e403ee2c414e]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:51:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9ef05117-79ab-46a1-a16b-c241e2c5d6ab tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.ab51ce91-39ae-4ce4-bbfd-18afb13410d3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:00 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-64626f38-976e-4e90-81c0-c95d4ffa4be9 tempest-VolumeDependencyTests-1384010995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.14ec81ef-0a49-4177-9d6f-eed5d9e43b76 1G" returned: 0 in 0.535s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-64626f38-976e-4e90-81c0-c95d4ffa4be9 tempest-VolumeDependencyTests-1384010995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.14ec81ef-0a49-4177-9d6f-eed5d9e43b76 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:00 devstack sudo[107748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.ab51ce91-39ae-4ce4-bbfd-18afb13410d3
Nov 07 02:52:00 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:00 devstack sudo[107750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.14ec81ef-0a49-4177-9d6f-eed5d9e43b76
Nov 07 02:52:00 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:00 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9ef05117-79ab-46a1-a16b-c241e2c5d6ab tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.ab51ce91-39ae-4ce4-bbfd-18afb13410d3" returned: 0 in 0.471s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:00 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-9ef05117-79ab-46a1-a16b-c241e2c5d6ab tempest-ProjectMemberTests-1907878748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dc366ec-2e12-4d46-a792-c71053b20e46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:52:00 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[0818cf91-ccd2-4abe-a2be-7f2863eadf27]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9ef05117-79ab-46a1-a16b-c241e2c5d6ab tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:00 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-64626f38-976e-4e90-81c0-c95d4ffa4be9 tempest-VolumeDependencyTests-1384010995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.14ec81ef-0a49-4177-9d6f-eed5d9e43b76" returned: 0 in 0.385s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:00 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-64626f38-976e-4e90-81c0-c95d4ffa4be9 tempest-VolumeDependencyTests-1384010995 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.14ec81ef-0a49-4177-9d6f-eed5d9e43b76 is being set with open permissions: ugo+rw
Nov 07 02:52:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-64626f38-976e-4e90-81c0-c95d4ffa4be9 tempest-VolumeDependencyTests-1384010995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.14ec81ef-0a49-4177-9d6f-eed5d9e43b76 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:00 devstack sudo[107760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.14ec81ef-0a49-4177-9d6f-eed5d9e43b76
Nov 07 02:52:00 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:00 devstack sudo[107759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46
Nov 07 02:52:00 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:00 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-64626f38-976e-4e90-81c0-c95d4ffa4be9 tempest-VolumeDependencyTests-1384010995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.14ec81ef-0a49-4177-9d6f-eed5d9e43b76" returned: 0 in 0.328s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-64626f38-976e-4e90-81c0-c95d4ffa4be9 tempest-VolumeDependencyTests-1384010995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:00 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9ef05117-79ab-46a1-a16b-c241e2c5d6ab tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46" returned: 0 in 0.431s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9ef05117-79ab-46a1-a16b-c241e2c5d6ab tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.ab51ce91-39ae-4ce4-bbfd-18afb13410d3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:00 devstack sudo[107768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.info
Nov 07 02:52:00 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:00 devstack sudo[107769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.ab51ce91-39ae-4ce4-bbfd-18afb13410d3
Nov 07 02:52:00 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:01 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-64626f38-976e-4e90-81c0-c95d4ffa4be9 tempest-VolumeDependencyTests-1384010995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.info" returned: 0 in 0.338s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:01 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-64626f38-976e-4e90-81c0-c95d4ffa4be9 tempest-VolumeDependencyTests-1384010995 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.info is being set with open permissions: ugo+rw
Nov 07 02:52:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-64626f38-976e-4e90-81c0-c95d4ffa4be9 tempest-VolumeDependencyTests-1384010995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:01 devstack sudo[107775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.info
Nov 07 02:52:01 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:01 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9ef05117-79ab-46a1-a16b-c241e2c5d6ab tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.ab51ce91-39ae-4ce4-bbfd-18afb13410d3" returned: 0 in 0.493s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9ef05117-79ab-46a1-a16b-c241e2c5d6ab tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.ab51ce91-39ae-4ce4-bbfd-18afb13410d3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:01 devstack sudo[107778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.ab51ce91-39ae-4ce4-bbfd-18afb13410d3
Nov 07 02:52:01 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:01 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-64626f38-976e-4e90-81c0-c95d4ffa4be9 tempest-VolumeDependencyTests-1384010995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.info" returned: 0 in 0.387s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-64626f38-976e-4e90-81c0-c95d4ffa4be9 tempest-VolumeDependencyTests-1384010995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.607s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:01 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-64626f38-976e-4e90-81c0-c95d4ffa4be9 tempest-VolumeDependencyTests-1384010995 None] Create snapshot completed successfully
Nov 07 02:52:01 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9ef05117-79ab-46a1-a16b-c241e2c5d6ab tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46.ab51ce91-39ae-4ce4-bbfd-18afb13410d3" returned: 0 in 0.335s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9ef05117-79ab-46a1-a16b-c241e2c5d6ab tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-ab51ce91-39ae-4ce4-bbfd-18afb13410d3" released by "_delete_snapshot" :: held 1.865s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9ef05117-79ab-46a1-a16b-c241e2c5d6ab tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-9dc366ec-2e12-4d46-a792-c71053b20e46" released by "delete_snapshot" :: held 1.894s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:01 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-9ef05117-79ab-46a1-a16b-c241e2c5d6ab tempest-ProjectMemberTests-1907878748 None] Created reservations ['65eb219e-8f31-43e1-aab1-49942eee4472', 'c7b8c210-0a63-4d4b-8934-3784d296f69b', 'ea99e084-2bde-496a-b895-628d0e044a62', '14a25f95-31e7-4076-bb4b-a82ab634b3c0'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:01 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-9ef05117-79ab-46a1-a16b-c241e2c5d6ab tempest-ProjectMemberTests-1907878748 None] Delete snapshot completed successfully.
Nov 07 02:52:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-9ef05117-79ab-46a1-a16b-c241e2c5d6ab tempest-ProjectMemberTests-1907878748 None] Lock "cinder-ab51ce91-39ae-4ce4-bbfd-18afb13410d3-delete_snapshot" released by "delete_snapshot" :: held 2.104s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6cc95727-e705-4fbb-bc2e-6ed9d7b25b10 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-9dc366ec-2e12-4d46-a792-c71053b20e46-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6cc95727-e705-4fbb-bc2e-6ed9d7b25b10 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-9dc366ec-2e12-4d46-a792-c71053b20e46-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6cc95727-e705-4fbb-bc2e-6ed9d7b25b10 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-9dc366ec-2e12-4d46-a792-c71053b20e46" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6cc95727-e705-4fbb-bc2e-6ed9d7b25b10 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-9dc366ec-2e12-4d46-a792-c71053b20e46" acquired by "delete_volume" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:02 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f00c02-0a12-45ec-8c3f-38643dffca50]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6cc95727-e705-4fbb-bc2e-6ed9d7b25b10 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:02 devstack sudo[107782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46
Nov 07 02:52:02 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:02 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6cc95727-e705-4fbb-bc2e-6ed9d7b25b10 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46" returned: 0 in 0.542s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6cc95727-e705-4fbb-bc2e-6ed9d7b25b10 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:02 devstack sudo[107787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46
Nov 07 02:52:02 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:03 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6cc95727-e705-4fbb-bc2e-6ed9d7b25b10 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-9dc366ec-2e12-4d46-a792-c71053b20e46" returned: 0 in 0.327s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6cc95727-e705-4fbb-bc2e-6ed9d7b25b10 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-9dc366ec-2e12-4d46-a792-c71053b20e46" released by "delete_volume" :: held 0.998s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-6cc95727-e705-4fbb-bc2e-6ed9d7b25b10 tempest-ProjectMemberTests-1907878748 None] Created reservations ['43b3cfb4-8983-4409-9802-c56c031a24ac', '143c7eca-2ca3-4471-b054-d5000719c7dc', 'e612fab0-662c-4fd8-b935-a5d894a42dc2', 'df8bd11b-b683-45f8-af7b-c430f7d012a3'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Flow 'volume_create_manager' (c0827056-7a97-4f95-8ddd-cb3875ce7d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ebb5f25-2d76-42ca-8808-6f01e3e8973f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ebb5f25-2d76-42ca-8808-6f01e3e8973f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1914535517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50139be8-af5e-44aa-9bc2-32ab35d1dcc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='369f1290f16c4e759ba3fd0138d81384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=14ec81ef-0a49-4177-9d6f-eed5d9e43b76,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:03Z,use_quota=True,user_id='1170960f37b84801aad8d5201b5fe903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc89bbb-eb08-4029-bc65-cffefc559aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc89bbb-eb08-4029-bc65-cffefc559aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71945072-aa66-4867-b09e-09d76914448c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71945072-aa66-4867-b09e-09d76914448c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '50139be8-af5e-44aa-9bc2-32ab35d1dcc7', 'volume_name': 'volume-50139be8-af5e-44aa-9bc2-32ab35d1dcc7', 'volume_size': 1, 'snapshot_id': '14ec81ef-0a49-4177-9d6f-eed5d9e43b76'}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59357072-a5ef-4d47-b39a-6693c95b0f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59357072-a5ef-4d47-b39a-6693c95b0f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc094326-94b3-4a3a-881c-1feedf59c338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:03 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Volume 50139be8-af5e-44aa-9bc2-32ab35d1dcc7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-50139be8-af5e-44aa-9bc2-32ab35d1dcc7', 'volume_size': 1, 'snapshot_id': '14ec81ef-0a49-4177-9d6f-eed5d9e43b76'}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Acquiring lock "cinder-quobyte-14ec81ef-0a49-4177-9d6f-eed5d9e43b76-50139be8-af5e-44aa-9bc2-32ab35d1dcc7" by "_create_volume_from_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Lock "cinder-quobyte-14ec81ef-0a49-4177-9d6f-eed5d9e43b76-50139be8-af5e-44aa-9bc2-32ab35d1dcc7" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Creating volume 50139be8-af5e-44aa-9bc2-32ab35d1dcc7 from snapshot 14ec81ef-0a49-4177-9d6f-eed5d9e43b76 {{(pid=87054) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Acquiring lock "cinder-quobyte-50139be8-af5e-44aa-9bc2-32ab35d1dcc7" by "_copy_volume_from_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6cc95727-e705-4fbb-bc2e-6ed9d7b25b10 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6cc95727-e705-4fbb-bc2e-6ed9d7b25b10 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6cc95727-e705-4fbb-bc2e-6ed9d7b25b10 tempest-ProjectMemberTests-1907878748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6cc95727-e705-4fbb-bc2e-6ed9d7b25b10 tempest-ProjectMemberTests-1907878748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6cc95727-e705-4fbb-bc2e-6ed9d7b25b10 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6cc95727-e705-4fbb-bc2e-6ed9d7b25b10 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Lock "cinder-quobyte-50139be8-af5e-44aa-9bc2-32ab35d1dcc7" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] snapshot: 14ec81ef-0a49-4177-9d6f-eed5d9e43b76, volume: 50139be8-af5e-44aa-9bc2-32ab35d1dcc7,  {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:52:03 devstack sudo[107790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:52:03 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[87240649-c4b9-4bf3-bd8b-a31723db4015]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.14ec81ef-0a49-4177-9d6f-eed5d9e43b76 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:03 devstack sudo[107792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.14ec81ef-0a49-4177-9d6f-eed5d9e43b76
Nov 07 02:52:03 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:03 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6cc95727-e705-4fbb-bc2e-6ed9d7b25b10 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.322s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6cc95727-e705-4fbb-bc2e-6ed9d7b25b10 tempest-ProjectMemberTests-1907878748 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:03 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-6cc95727-e705-4fbb-bc2e-6ed9d7b25b10 tempest-ProjectMemberTests-1907878748 None] Deleted volume successfully.
Nov 07 02:52:03 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-6cc95727-e705-4fbb-bc2e-6ed9d7b25b10 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-9dc366ec-2e12-4d46-a792-c71053b20e46-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:04 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.14ec81ef-0a49-4177-9d6f-eed5d9e43b76" returned: 0 in 0.455s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:52:04 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[318dc8a2-85fe-4fec-beba-d2354951cd85]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:04 devstack sudo[107798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b
Nov 07 02:52:04 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:04 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b" returned: 0 in 0.441s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:52:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Creating direct copy from snapshot {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:52:04 devstack cinder-volume[87054]: DEBUG cinder.utils [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Path /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-50139be8-af5e-44aa-9bc2-32ab35d1dcc7 not found in is_blk_device check {{(pid=87054) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:52:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-50139be8-af5e-44aa-9bc2-32ab35d1dcc7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:04 devstack sudo[107803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-50139be8-af5e-44aa-9bc2-32ab35d1dcc7
Nov 07 02:52:04 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Flow 'volume_create_manager' (cab1c408-275a-40a5-aa72-831cf20ea5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f198a7-89cd-456f-95af-a84acce2d1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f198a7-89cd-456f-95af-a84acce2d1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1699122518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad74036e-6e22-4de1-824c-fa77e47e8fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90854e8da8b14aa28568e8beba706c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:05Z,use_quota=True,user_id='813ad50b030d4d3fac7f68412673b863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a71faa72-ee84-4720-a908-34632f02113f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a71faa72-ee84-4720-a908-34632f02113f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c255fb-f563-4da5-844d-0007239e7090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c255fb-f563-4da5-844d-0007239e7090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad74036e-6e22-4de1-824c-fa77e47e8fd7', 'volume_name': 'volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd6ac2fc-2ad6-4ba0-b052-a0ee4bbdc125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd6ac2fc-2ad6-4ba0-b052-a0ee4bbdc125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693d22a6-8eae-4299-9770-96038b85b0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:05 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Volume ad74036e-6e22-4de1-824c-fa77e47e8fd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7', 'volume_size': 1}
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Flow 'volume_create_manager' (92b00636-004b-48e9-ae56-1042e4bbc35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b904a6c-9aae-4990-8fde-91e838f995ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b904a6c-9aae-4990-8fde-91e838f995ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1968145827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd8bdb4-23cf-43d4-a340-1a741ece1b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561b2b8c4de24651a364c4cb9b1460c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:05Z,use_quota=True,user_id='b507b952edd14904acb6904428c12ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924508d8-37ca-4152-89c3-12b8aede5732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924508d8-37ca-4152-89c3-12b8aede5732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f0bd74-e2fd-4da0-90a3-0c9cd49a57d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f0bd74-e2fd-4da0-90a3-0c9cd49a57d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edd8bdb4-23cf-43d4-a340-1a741ece1b1b', 'volume_name': 'volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec9f516-364a-4362-8e25-7e35bdd3bb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec9f516-364a-4362-8e25-7e35bdd3bb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (959e5bf4-f257-4a84-8b82-0d6498645cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:05 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Volume edd8bdb4-23cf-43d4-a340-1a741ece1b1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b', 'volume_size': 1}
Nov 07 02:52:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:12 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-50139be8-af5e-44aa-9bc2-32ab35d1dcc7" returned: 0 in 8.252s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:12 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Image conversion details: src /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b, size 1024.00 MB, duration 8.25 sec, destination /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-50139be8-af5e-44aa-9bc2-32ab35d1dcc7 {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:52:12 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Converted 1024.00 MB image at 124.08 MB/s
Nov 07 02:52:12 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-50139be8-af5e-44aa-9bc2-32ab35d1dcc7 is being set with open permissions: ugo+rw
Nov 07 02:52:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-50139be8-af5e-44aa-9bc2-32ab35d1dcc7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:12 devstack sudo[107853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-50139be8-af5e-44aa-9bc2-32ab35d1dcc7
Nov 07 02:52:12 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:13 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-50139be8-af5e-44aa-9bc2-32ab35d1dcc7" returned: 0 in 0.263s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Lock "cinder-quobyte-50139be8-af5e-44aa-9bc2-32ab35d1dcc7" released by "_copy_volume_from_snapshot" :: held 9.543s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=212,cinder:UPDATE=287,cinder:DELETE=32,cinder:INSERT=72 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Lock "cinder-quobyte-14ec81ef-0a49-4177-9d6f-eed5d9e43b76-50139be8-af5e-44aa-9bc2-32ab35d1dcc7" released by "_create_volume_from_snapshot" :: held 9.659s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.684s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.590s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1699122518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad74036e-6e22-4de1-824c-fa77e47e8fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90854e8da8b14aa28568e8beba706c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:05Z,use_quota=True,user_id='813ad50b030d4d3fac7f68412673b863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Creating volume ad74036e-6e22-4de1-824c-fa77e47e8fd7 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:13 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:13 devstack sudo[107856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7 1073741824
Nov 07 02:52:13 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc094326-94b3-4a3a-881c-1feedf59c338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50139be8-af5e-44aa-9bc2-32ab35d1dcc7', 'volume_size': 1, 'snapshot_id': '14ec81ef-0a49-4177-9d6f-eed5d9e43b76'}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a2136d-59b5-4a36-b4a5-79e6427becff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:13 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Volume volume-50139be8-af5e-44aa-9bc2-32ab35d1dcc7 (50139be8-af5e-44aa-9bc2-32ab35d1dcc7): created successfully
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a2136d-59b5-4a36-b4a5-79e6427becff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Flow 'volume_create_manager' (c0827056-7a97-4f95-8ddd-cb3875ce7d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:13 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-962b461f-d09b-49fd-bcc9-cc3fbcd3308c tempest-VolumeDependencyTests-1384010995 None] Created volume successfully.
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ebffe4a1-29f3-4fb3-97fb-44fdd913140c tempest-VolumeDependencyTests-1384010995 None] Acquiring lock "cinder-14ec81ef-0a49-4177-9d6f-eed5d9e43b76-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ebffe4a1-29f3-4fb3-97fb-44fdd913140c tempest-VolumeDependencyTests-1384010995 None] Lock "cinder-14ec81ef-0a49-4177-9d6f-eed5d9e43b76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ebffe4a1-29f3-4fb3-97fb-44fdd913140c tempest-VolumeDependencyTests-1384010995 None] Acquiring lock "cinder-quobyte-eb0d583a-a502-44ba-ab8b-e560c46b9f8b" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ebffe4a1-29f3-4fb3-97fb-44fdd913140c tempest-VolumeDependencyTests-1384010995 None] Lock "cinder-quobyte-eb0d583a-a502-44ba-ab8b-e560c46b9f8b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ebffe4a1-29f3-4fb3-97fb-44fdd913140c tempest-VolumeDependencyTests-1384010995 None] Acquiring lock "cinder-quobyte-14ec81ef-0a49-4177-9d6f-eed5d9e43b76" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ebffe4a1-29f3-4fb3-97fb-44fdd913140c tempest-VolumeDependencyTests-1384010995 None] Lock "cinder-quobyte-14ec81ef-0a49-4177-9d6f-eed5d9e43b76" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ebffe4a1-29f3-4fb3-97fb-44fdd913140c tempest-VolumeDependencyTests-1384010995 None] Deleting offline snapshot 14ec81ef-0a49-4177-9d6f-eed5d9e43b76 of volume eb0d583a-a502-44ba-ab8b-e560c46b9f8b {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ebffe4a1-29f3-4fb3-97fb-44fdd913140c tempest-VolumeDependencyTests-1384010995 None] snapshot_file for this snap is: volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.14ec81ef-0a49-4177-9d6f-eed5d9e43b76 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a795bb-e784-487e-8e26-d82d30397579]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ebffe4a1-29f3-4fb3-97fb-44fdd913140c tempest-VolumeDependencyTests-1384010995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.14ec81ef-0a49-4177-9d6f-eed5d9e43b76 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:13 devstack sudo[107861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.14ec81ef-0a49-4177-9d6f-eed5d9e43b76
Nov 07 02:52:13 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:13 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7 1073741824" returned: 0 in 0.645s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:13 devstack sudo[107864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7
Nov 07 02:52:13 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:13 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ebffe4a1-29f3-4fb3-97fb-44fdd913140c tempest-VolumeDependencyTests-1384010995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.14ec81ef-0a49-4177-9d6f-eed5d9e43b76" returned: 0 in 0.425s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:13 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ebffe4a1-29f3-4fb3-97fb-44fdd913140c tempest-VolumeDependencyTests-1384010995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:52:14 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50705ab-b13a-4dff-aeb9-48109e374c4c]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ebffe4a1-29f3-4fb3-97fb-44fdd913140c tempest-VolumeDependencyTests-1384010995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:14 devstack sudo[107870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b
Nov 07 02:52:14 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:14 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7" returned: 0 in 0.272s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.375s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1968145827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd8bdb4-23cf-43d4-a340-1a741ece1b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561b2b8c4de24651a364c4cb9b1460c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:05Z,use_quota=True,user_id='b507b952edd14904acb6904428c12ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Creating volume edd8bdb4-23cf-43d4-a340-1a741ece1b1b {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:14 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:52:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693d22a6-8eae-4299-9770-96038b85b0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546e1e6e-f3be-433c-9504-6b1db5ee501b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:14 devstack sudo[107873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b 1073741824
Nov 07 02:52:14 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:14 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Volume volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7 (ad74036e-6e22-4de1-824c-fa77e47e8fd7): created successfully
Nov 07 02:52:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546e1e6e-f3be-433c-9504-6b1db5ee501b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:14 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Flow 'volume_create_manager' (cab1c408-275a-40a5-aa72-831cf20ea5aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:14 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-3f1790da-4c37-4d75-b54d-81f1514cd51c tempest-ProjectMemberTests-1907878748 None] Created volume successfully.
Nov 07 02:52:14 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ebffe4a1-29f3-4fb3-97fb-44fdd913140c tempest-VolumeDependencyTests-1384010995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b" returned: 0 in 0.607s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ebffe4a1-29f3-4fb3-97fb-44fdd913140c tempest-VolumeDependencyTests-1384010995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.14ec81ef-0a49-4177-9d6f-eed5d9e43b76 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:14 devstack sudo[107882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.14ec81ef-0a49-4177-9d6f-eed5d9e43b76
Nov 07 02:52:14 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:14 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b 1073741824" returned: 0 in 0.512s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:14 devstack sudo[107884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b
Nov 07 02:52:14 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:15 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b" returned: 0 in 0.368s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (959e5bf4-f257-4a84-8b82-0d6498645cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece8336f-3086-4fd0-a98f-a673659cda57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:15 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ebffe4a1-29f3-4fb3-97fb-44fdd913140c tempest-VolumeDependencyTests-1384010995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.14ec81ef-0a49-4177-9d6f-eed5d9e43b76" returned: 0 in 0.496s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ebffe4a1-29f3-4fb3-97fb-44fdd913140c tempest-VolumeDependencyTests-1384010995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.14ec81ef-0a49-4177-9d6f-eed5d9e43b76 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f98571f7-b662-4f7e-8b97-e80e45a50cd8 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f98571f7-b662-4f7e-8b97-e80e45a50cd8 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:15 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Volume volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b (edd8bdb4-23cf-43d4-a340-1a741ece1b1b): created successfully
Nov 07 02:52:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece8336f-3086-4fd0-a98f-a673659cda57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Flow 'volume_create_manager' (92b00636-004b-48e9-ae56-1042e4bbc35f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:15 devstack sudo[107898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.14ec81ef-0a49-4177-9d6f-eed5d9e43b76
Nov 07 02:52:15 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-f98571f7-b662-4f7e-8b97-e80e45a50cd8 tempest-ProjectMemberTests-1907878748 None] Creating offline snapshot 4bbb9fa7-d935-49e5-b080-512e0e329884 of volume ad74036e-6e22-4de1-824c-fa77e47e8fd7 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:52:15 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f572c39a-570b-4fa7-aad8-49c67a4e6293 tempest-ProjectReaderTests-1512630701 None] Created volume successfully.
Nov 07 02:52:15 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44fbd71-03df-4573-8b8f-b87876797b0a]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f98571f7-b662-4f7e-8b97-e80e45a50cd8 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:15 devstack sudo[107900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7
Nov 07 02:52:15 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:15 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ebffe4a1-29f3-4fb3-97fb-44fdd913140c tempest-VolumeDependencyTests-1384010995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b.14ec81ef-0a49-4177-9d6f-eed5d9e43b76" returned: 0 in 0.275s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ebffe4a1-29f3-4fb3-97fb-44fdd913140c tempest-VolumeDependencyTests-1384010995 None] Lock "cinder-quobyte-14ec81ef-0a49-4177-9d6f-eed5d9e43b76" released by "_delete_snapshot" :: held 1.958s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ebffe4a1-29f3-4fb3-97fb-44fdd913140c tempest-VolumeDependencyTests-1384010995 None] Lock "cinder-quobyte-eb0d583a-a502-44ba-ab8b-e560c46b9f8b" released by "delete_snapshot" :: held 1.995s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:15 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-ebffe4a1-29f3-4fb3-97fb-44fdd913140c tempest-VolumeDependencyTests-1384010995 None] Created reservations ['a0888954-3446-4048-8548-7166ad9e45b6', '5910fef7-003d-4458-8a05-6c09461efb0e', 'c46e32d9-169c-426a-9561-033de3bf6588', 'c1f592e6-f292-445c-82a1-6aececf51b59'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:15 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f98571f7-b662-4f7e-8b97-e80e45a50cd8 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7" returned: 0 in 0.438s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f98571f7-b662-4f7e-8b97-e80e45a50cd8 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.4bbb9fa7-d935-49e5-b080-512e0e329884 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:15 devstack sudo[107906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.4bbb9fa7-d935-49e5-b080-512e0e329884 1G
Nov 07 02:52:15 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:15 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ebffe4a1-29f3-4fb3-97fb-44fdd913140c tempest-VolumeDependencyTests-1384010995 None] Delete snapshot completed successfully.
Nov 07 02:52:15 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ebffe4a1-29f3-4fb3-97fb-44fdd913140c tempest-VolumeDependencyTests-1384010995 None] Lock "cinder-14ec81ef-0a49-4177-9d6f-eed5d9e43b76-delete_snapshot" released by "delete_snapshot" :: held 2.225s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:16 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f98571f7-b662-4f7e-8b97-e80e45a50cd8 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.4bbb9fa7-d935-49e5-b080-512e0e329884 1G" returned: 0 in 0.452s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f98571f7-b662-4f7e-8b97-e80e45a50cd8 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.4bbb9fa7-d935-49e5-b080-512e0e329884 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:16 devstack sudo[107912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.4bbb9fa7-d935-49e5-b080-512e0e329884
Nov 07 02:52:16 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-46ab3c25-01e5-41f4-875e-d80a0ac3db2c tempest-ProjectReaderTests-1512630701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:16 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f98571f7-b662-4f7e-8b97-e80e45a50cd8 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.4bbb9fa7-d935-49e5-b080-512e0e329884" returned: 0 in 0.353s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:16 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-f98571f7-b662-4f7e-8b97-e80e45a50cd8 tempest-ProjectMemberTests-1907878748 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.4bbb9fa7-d935-49e5-b080-512e0e329884 is being set with open permissions: ugo+rw
Nov 07 02:52:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f98571f7-b662-4f7e-8b97-e80e45a50cd8 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.4bbb9fa7-d935-49e5-b080-512e0e329884 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:16 devstack sudo[107917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.4bbb9fa7-d935-49e5-b080-512e0e329884
Nov 07 02:52:16 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-edccfe7a-db8a-4e93-b7b8-44b7c084aa7a tempest-VolumeDependencyTests-1384010995 None] Acquiring lock "cinder-eb0d583a-a502-44ba-ab8b-e560c46b9f8b-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:16 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f98571f7-b662-4f7e-8b97-e80e45a50cd8 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.4bbb9fa7-d935-49e5-b080-512e0e329884" returned: 0 in 0.256s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-edccfe7a-db8a-4e93-b7b8-44b7c084aa7a tempest-VolumeDependencyTests-1384010995 None] Lock "cinder-eb0d583a-a502-44ba-ab8b-e560c46b9f8b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f98571f7-b662-4f7e-8b97-e80e45a50cd8 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:16 devstack sudo[107920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.info
Nov 07 02:52:16 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-edccfe7a-db8a-4e93-b7b8-44b7c084aa7a tempest-VolumeDependencyTests-1384010995 None] Acquiring lock "cinder-quobyte-eb0d583a-a502-44ba-ab8b-e560c46b9f8b" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-edccfe7a-db8a-4e93-b7b8-44b7c084aa7a tempest-VolumeDependencyTests-1384010995 None] Lock "cinder-quobyte-eb0d583a-a502-44ba-ab8b-e560c46b9f8b" acquired by "delete_volume" :: waited 0.018s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:16 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ee2d25-1e85-430e-abbc-61c6bb3a5851]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-edccfe7a-db8a-4e93-b7b8-44b7c084aa7a tempest-VolumeDependencyTests-1384010995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:16 devstack sudo[107922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b
Nov 07 02:52:17 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:17 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f98571f7-b662-4f7e-8b97-e80e45a50cd8 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.info" returned: 0 in 0.299s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:17 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-f98571f7-b662-4f7e-8b97-e80e45a50cd8 tempest-ProjectMemberTests-1907878748 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.info is being set with open permissions: ugo+rw
Nov 07 02:52:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f98571f7-b662-4f7e-8b97-e80e45a50cd8 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:17 devstack sudo[107925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.info
Nov 07 02:52:17 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:17 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-edccfe7a-db8a-4e93-b7b8-44b7c084aa7a tempest-VolumeDependencyTests-1384010995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b" returned: 0 in 0.419s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-edccfe7a-db8a-4e93-b7b8-44b7c084aa7a tempest-VolumeDependencyTests-1384010995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:17 devstack sudo[107932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b
Nov 07 02:52:17 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:17 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f98571f7-b662-4f7e-8b97-e80e45a50cd8 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.info" returned: 0 in 0.272s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f98571f7-b662-4f7e-8b97-e80e45a50cd8 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.223s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-46ab3c25-01e5-41f4-875e-d80a0ac3db2c tempest-ProjectReaderTests-1512630701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.964s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-46ab3c25-01e5-41f4-875e-d80a0ac3db2c tempest-ProjectReaderTests-1512630701 None] Creating offline snapshot de7607c6-da5e-433b-bd4b-fb2a1bde3575 of volume edd8bdb4-23cf-43d4-a340-1a741ece1b1b {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:52:17 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f98571f7-b662-4f7e-8b97-e80e45a50cd8 tempest-ProjectMemberTests-1907878748 None] Create snapshot completed successfully
Nov 07 02:52:17 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d0248f-4470-4ea1-aa25-93c53a72cc39]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-46ab3c25-01e5-41f4-875e-d80a0ac3db2c tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:17 devstack sudo[107934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b
Nov 07 02:52:17 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:17 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-edccfe7a-db8a-4e93-b7b8-44b7c084aa7a tempest-VolumeDependencyTests-1384010995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-eb0d583a-a502-44ba-ab8b-e560c46b9f8b" returned: 0 in 0.269s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:17 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-edccfe7a-db8a-4e93-b7b8-44b7c084aa7a tempest-VolumeDependencyTests-1384010995 None] Lock "cinder-quobyte-eb0d583a-a502-44ba-ab8b-e560c46b9f8b" released by "delete_volume" :: held 0.763s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:17 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-edccfe7a-db8a-4e93-b7b8-44b7c084aa7a tempest-VolumeDependencyTests-1384010995 None] Created reservations ['c3a2edba-dd2d-43bd-b342-54d539b4aeb9', 'ba171fa5-0665-48fb-935a-6c4285c8fbf4', 'c47f78df-733d-40ed-933e-70c4065f64b6', '9e23c345-b8a5-4128-bd99-7bc2fc1a6318'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-edccfe7a-db8a-4e93-b7b8-44b7c084aa7a tempest-VolumeDependencyTests-1384010995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-edccfe7a-db8a-4e93-b7b8-44b7c084aa7a tempest-VolumeDependencyTests-1384010995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-edccfe7a-db8a-4e93-b7b8-44b7c084aa7a tempest-VolumeDependencyTests-1384010995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-edccfe7a-db8a-4e93-b7b8-44b7c084aa7a tempest-VolumeDependencyTests-1384010995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-edccfe7a-db8a-4e93-b7b8-44b7c084aa7a tempest-VolumeDependencyTests-1384010995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-edccfe7a-db8a-4e93-b7b8-44b7c084aa7a tempest-VolumeDependencyTests-1384010995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:17 devstack sudo[107937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:52:17 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:17 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-46ab3c25-01e5-41f4-875e-d80a0ac3db2c tempest-ProjectReaderTests-1512630701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b" returned: 0 in 0.425s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-46ab3c25-01e5-41f4-875e-d80a0ac3db2c tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.de7607c6-da5e-433b-bd4b-fb2a1bde3575 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:17 devstack sudo[107943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.de7607c6-da5e-433b-bd4b-fb2a1bde3575 1G
Nov 07 02:52:17 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:17 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-99b3bd56-9b35-4985-921d-94ac3860ae71 tempest-VolumeDependencyTests-1384010995 None] Acquiring lock "cinder-50139be8-af5e-44aa-9bc2-32ab35d1dcc7-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:17 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-99b3bd56-9b35-4985-921d-94ac3860ae71 tempest-VolumeDependencyTests-1384010995 None] Lock "cinder-50139be8-af5e-44aa-9bc2-32ab35d1dcc7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-99b3bd56-9b35-4985-921d-94ac3860ae71 tempest-VolumeDependencyTests-1384010995 None] Acquiring lock "cinder-quobyte-50139be8-af5e-44aa-9bc2-32ab35d1dcc7" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-99b3bd56-9b35-4985-921d-94ac3860ae71 tempest-VolumeDependencyTests-1384010995 None] Lock "cinder-quobyte-50139be8-af5e-44aa-9bc2-32ab35d1dcc7" acquired by "delete_volume" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3077004-a7dd-492e-b53a-40e893bd5af6]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-99b3bd56-9b35-4985-921d-94ac3860ae71 tempest-VolumeDependencyTests-1384010995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-50139be8-af5e-44aa-9bc2-32ab35d1dcc7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:18 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-edccfe7a-db8a-4e93-b7b8-44b7c084aa7a tempest-VolumeDependencyTests-1384010995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.376s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-edccfe7a-db8a-4e93-b7b8-44b7c084aa7a tempest-VolumeDependencyTests-1384010995 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:18 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-edccfe7a-db8a-4e93-b7b8-44b7c084aa7a tempest-VolumeDependencyTests-1384010995 None] Deleted volume successfully.
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-edccfe7a-db8a-4e93-b7b8-44b7c084aa7a tempest-VolumeDependencyTests-1384010995 None] Lock "cinder-eb0d583a-a502-44ba-ab8b-e560c46b9f8b-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:18 devstack sudo[107946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-50139be8-af5e-44aa-9bc2-32ab35d1dcc7
Nov 07 02:52:18 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ce7e4ac4-e1fc-496b-8870-9c1e893b0487 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-4bbb9fa7-d935-49e5-b080-512e0e329884-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ce7e4ac4-e1fc-496b-8870-9c1e893b0487 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-4bbb9fa7-d935-49e5-b080-512e0e329884-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ce7e4ac4-e1fc-496b-8870-9c1e893b0487 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-ad74036e-6e22-4de1-824c-fa77e47e8fd7" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ce7e4ac4-e1fc-496b-8870-9c1e893b0487 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-ad74036e-6e22-4de1-824c-fa77e47e8fd7" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ce7e4ac4-e1fc-496b-8870-9c1e893b0487 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-4bbb9fa7-d935-49e5-b080-512e0e329884" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ce7e4ac4-e1fc-496b-8870-9c1e893b0487 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-4bbb9fa7-d935-49e5-b080-512e0e329884" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ce7e4ac4-e1fc-496b-8870-9c1e893b0487 tempest-ProjectMemberTests-1907878748 None] Deleting offline snapshot 4bbb9fa7-d935-49e5-b080-512e0e329884 of volume ad74036e-6e22-4de1-824c-fa77e47e8fd7 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ce7e4ac4-e1fc-496b-8870-9c1e893b0487 tempest-ProjectMemberTests-1907878748 None] snapshot_file for this snap is: volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.4bbb9fa7-d935-49e5-b080-512e0e329884 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08df7cd-5889-41e9-a2f8-4bbd633ca8c8]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ce7e4ac4-e1fc-496b-8870-9c1e893b0487 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.4bbb9fa7-d935-49e5-b080-512e0e329884 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:18 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-46ab3c25-01e5-41f4-875e-d80a0ac3db2c tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.de7607c6-da5e-433b-bd4b-fb2a1bde3575 1G" returned: 0 in 0.697s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-46ab3c25-01e5-41f4-875e-d80a0ac3db2c tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.de7607c6-da5e-433b-bd4b-fb2a1bde3575 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:18 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-99b3bd56-9b35-4985-921d-94ac3860ae71 tempest-VolumeDependencyTests-1384010995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-50139be8-af5e-44aa-9bc2-32ab35d1dcc7" returned: 0 in 0.512s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:18 devstack sudo[107957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.de7607c6-da5e-433b-bd4b-fb2a1bde3575
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-99b3bd56-9b35-4985-921d-94ac3860ae71 tempest-VolumeDependencyTests-1384010995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-50139be8-af5e-44aa-9bc2-32ab35d1dcc7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:18 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:18 devstack sudo[107953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.4bbb9fa7-d935-49e5-b080-512e0e329884
Nov 07 02:52:18 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:18 devstack sudo[107959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-50139be8-af5e-44aa-9bc2-32ab35d1dcc7
Nov 07 02:52:18 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:18 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:18 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ce7e4ac4-e1fc-496b-8870-9c1e893b0487 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.4bbb9fa7-d935-49e5-b080-512e0e329884" returned: 0 in 0.402s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ce7e4ac4-e1fc-496b-8870-9c1e893b0487 tempest-ProjectMemberTests-1907878748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:52:18 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-99b3bd56-9b35-4985-921d-94ac3860ae71 tempest-VolumeDependencyTests-1384010995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-50139be8-af5e-44aa-9bc2-32ab35d1dcc7" returned: 0 in 0.317s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-46ab3c25-01e5-41f4-875e-d80a0ac3db2c tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.de7607c6-da5e-433b-bd4b-fb2a1bde3575" returned: 0 in 0.356s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:18 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-46ab3c25-01e5-41f4-875e-d80a0ac3db2c tempest-ProjectReaderTests-1512630701 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.de7607c6-da5e-433b-bd4b-fb2a1bde3575 is being set with open permissions: ugo+rw
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-46ab3c25-01e5-41f4-875e-d80a0ac3db2c tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.de7607c6-da5e-433b-bd4b-fb2a1bde3575 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[356577f1-2f1a-480c-9b47-3d405f4288df]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ce7e4ac4-e1fc-496b-8870-9c1e893b0487 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:18 devstack sudo[107971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.de7607c6-da5e-433b-bd4b-fb2a1bde3575
Nov 07 02:52:18 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-99b3bd56-9b35-4985-921d-94ac3860ae71 tempest-VolumeDependencyTests-1384010995 None] Lock "cinder-quobyte-50139be8-af5e-44aa-9bc2-32ab35d1dcc7" released by "delete_volume" :: held 0.913s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:19 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-99b3bd56-9b35-4985-921d-94ac3860ae71 tempest-VolumeDependencyTests-1384010995 None] Created reservations ['29d65da5-e695-4998-9d7d-5663b2ee4672', '5992690e-e596-462c-b721-505e17466fd5', 'a23c5ad4-4bec-4c54-a746-6b4793b19816', '2ea52544-5908-45f8-8502-f8c4e56a6392'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:19 devstack sudo[107972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7
Nov 07 02:52:19 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-99b3bd56-9b35-4985-921d-94ac3860ae71 tempest-VolumeDependencyTests-1384010995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-99b3bd56-9b35-4985-921d-94ac3860ae71 tempest-VolumeDependencyTests-1384010995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-99b3bd56-9b35-4985-921d-94ac3860ae71 tempest-VolumeDependencyTests-1384010995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-99b3bd56-9b35-4985-921d-94ac3860ae71 tempest-VolumeDependencyTests-1384010995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-99b3bd56-9b35-4985-921d-94ac3860ae71 tempest-VolumeDependencyTests-1384010995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-99b3bd56-9b35-4985-921d-94ac3860ae71 tempest-VolumeDependencyTests-1384010995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:19 devstack sudo[107975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:52:19 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:19 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-46ab3c25-01e5-41f4-875e-d80a0ac3db2c tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.de7607c6-da5e-433b-bd4b-fb2a1bde3575" returned: 0 in 0.352s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-46ab3c25-01e5-41f4-875e-d80a0ac3db2c tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:19 devstack sudo[107980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.info
Nov 07 02:52:19 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:19 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ce7e4ac4-e1fc-496b-8870-9c1e893b0487 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7" returned: 0 in 0.569s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ce7e4ac4-e1fc-496b-8870-9c1e893b0487 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.4bbb9fa7-d935-49e5-b080-512e0e329884 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:19 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-99b3bd56-9b35-4985-921d-94ac3860ae71 tempest-VolumeDependencyTests-1384010995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.463s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:19 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-99b3bd56-9b35-4985-921d-94ac3860ae71 tempest-VolumeDependencyTests-1384010995 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:19 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-99b3bd56-9b35-4985-921d-94ac3860ae71 tempest-VolumeDependencyTests-1384010995 None] Deleted volume successfully.
Nov 07 02:52:19 devstack sudo[107986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.4bbb9fa7-d935-49e5-b080-512e0e329884
Nov 07 02:52:19 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:19 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-99b3bd56-9b35-4985-921d-94ac3860ae71 tempest-VolumeDependencyTests-1384010995 None] Lock "cinder-50139be8-af5e-44aa-9bc2-32ab35d1dcc7-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:19 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-46ab3c25-01e5-41f4-875e-d80a0ac3db2c tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.info" returned: 0 in 0.404s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:19 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-46ab3c25-01e5-41f4-875e-d80a0ac3db2c tempest-ProjectReaderTests-1512630701 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.info is being set with open permissions: ugo+rw
Nov 07 02:52:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-46ab3c25-01e5-41f4-875e-d80a0ac3db2c tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:19 devstack sudo[107989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.info
Nov 07 02:52:19 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:20 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:20 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-46ab3c25-01e5-41f4-875e-d80a0ac3db2c tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.info" returned: 0 in 0.320s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-46ab3c25-01e5-41f4-875e-d80a0ac3db2c tempest-ProjectReaderTests-1512630701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.713s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ce7e4ac4-e1fc-496b-8870-9c1e893b0487 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.4bbb9fa7-d935-49e5-b080-512e0e329884" returned: 0 in 0.571s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ce7e4ac4-e1fc-496b-8870-9c1e893b0487 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.4bbb9fa7-d935-49e5-b080-512e0e329884 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:20 devstack sudo[107996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.4bbb9fa7-d935-49e5-b080-512e0e329884
Nov 07 02:52:20 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:20 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-46ab3c25-01e5-41f4-875e-d80a0ac3db2c tempest-ProjectReaderTests-1512630701 None] Create snapshot completed successfully
Nov 07 02:52:20 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ce7e4ac4-e1fc-496b-8870-9c1e893b0487 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7.4bbb9fa7-d935-49e5-b080-512e0e329884" returned: 0 in 0.311s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ce7e4ac4-e1fc-496b-8870-9c1e893b0487 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-4bbb9fa7-d935-49e5-b080-512e0e329884" released by "_delete_snapshot" :: held 2.009s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ce7e4ac4-e1fc-496b-8870-9c1e893b0487 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-ad74036e-6e22-4de1-824c-fa77e47e8fd7" released by "delete_snapshot" :: held 2.036s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:20 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-ce7e4ac4-e1fc-496b-8870-9c1e893b0487 tempest-ProjectMemberTests-1907878748 None] Created reservations ['5bb85145-0671-458e-9582-4e60b1b9150d', '306bb537-5e86-47f9-8e1f-558421c701bc', '1fbab397-bce7-4d6b-b86c-ada2ea6e2c26', 'bdf7b54a-78eb-4fde-b11d-b0799e08163c'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:20 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ce7e4ac4-e1fc-496b-8870-9c1e893b0487 tempest-ProjectMemberTests-1907878748 None] Delete snapshot completed successfully.
Nov 07 02:52:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ce7e4ac4-e1fc-496b-8870-9c1e893b0487 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-4bbb9fa7-d935-49e5-b080-512e0e329884-delete_snapshot" released by "delete_snapshot" :: held 2.278s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1cfc9eb9-3e8d-4417-a25a-bf8d02a21d64 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-de7607c6-da5e-433b-bd4b-fb2a1bde3575-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1cfc9eb9-3e8d-4417-a25a-bf8d02a21d64 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-de7607c6-da5e-433b-bd4b-fb2a1bde3575-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1cfc9eb9-3e8d-4417-a25a-bf8d02a21d64 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-quobyte-edd8bdb4-23cf-43d4-a340-1a741ece1b1b" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1cfc9eb9-3e8d-4417-a25a-bf8d02a21d64 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-edd8bdb4-23cf-43d4-a340-1a741ece1b1b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1cfc9eb9-3e8d-4417-a25a-bf8d02a21d64 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-quobyte-de7607c6-da5e-433b-bd4b-fb2a1bde3575" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1cfc9eb9-3e8d-4417-a25a-bf8d02a21d64 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-de7607c6-da5e-433b-bd4b-fb2a1bde3575" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:21 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-1cfc9eb9-3e8d-4417-a25a-bf8d02a21d64 tempest-ProjectReaderTests-1512630701 None] Deleting offline snapshot de7607c6-da5e-433b-bd4b-fb2a1bde3575 of volume edd8bdb4-23cf-43d4-a340-1a741ece1b1b {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:52:21 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-1cfc9eb9-3e8d-4417-a25a-bf8d02a21d64 tempest-ProjectReaderTests-1512630701 None] snapshot_file for this snap is: volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.de7607c6-da5e-433b-bd4b-fb2a1bde3575 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:52:21 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd399484-aa4a-44a1-aac9-83862acb837a]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1cfc9eb9-3e8d-4417-a25a-bf8d02a21d64 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.de7607c6-da5e-433b-bd4b-fb2a1bde3575 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:21 devstack sudo[107999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.de7607c6-da5e-433b-bd4b-fb2a1bde3575
Nov 07 02:52:21 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:21 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1cfc9eb9-3e8d-4417-a25a-bf8d02a21d64 tempest-ProjectReaderTests-1512630701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.de7607c6-da5e-433b-bd4b-fb2a1bde3575" returned: 0 in 0.442s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:21 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-1cfc9eb9-3e8d-4417-a25a-bf8d02a21d64 tempest-ProjectReaderTests-1512630701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:52:21 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d962f8-7d77-40dc-807a-c29e4cfa353c]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1cfc9eb9-3e8d-4417-a25a-bf8d02a21d64 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a9fe9d35-13bd-42f2-b0ec-a56897c6e719 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-ad74036e-6e22-4de1-824c-fa77e47e8fd7-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a9fe9d35-13bd-42f2-b0ec-a56897c6e719 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-ad74036e-6e22-4de1-824c-fa77e47e8fd7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:21 devstack sudo[108004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b
Nov 07 02:52:21 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a9fe9d35-13bd-42f2-b0ec-a56897c6e719 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-ad74036e-6e22-4de1-824c-fa77e47e8fd7" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a9fe9d35-13bd-42f2-b0ec-a56897c6e719 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-ad74036e-6e22-4de1-824c-fa77e47e8fd7" acquired by "delete_volume" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:21 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43b94bb-22f7-4a45-af66-8cf8bec51045]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a9fe9d35-13bd-42f2-b0ec-a56897c6e719 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:21 devstack sudo[108006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7
Nov 07 02:52:21 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:22 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1cfc9eb9-3e8d-4417-a25a-bf8d02a21d64 tempest-ProjectReaderTests-1512630701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b" returned: 0 in 0.519s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1cfc9eb9-3e8d-4417-a25a-bf8d02a21d64 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.de7607c6-da5e-433b-bd4b-fb2a1bde3575 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:22 devstack sudo[108011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.de7607c6-da5e-433b-bd4b-fb2a1bde3575
Nov 07 02:52:22 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:22 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a9fe9d35-13bd-42f2-b0ec-a56897c6e719 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7" returned: 0 in 0.485s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a9fe9d35-13bd-42f2-b0ec-a56897c6e719 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:22 devstack sudo[108018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7
Nov 07 02:52:22 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:22 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1cfc9eb9-3e8d-4417-a25a-bf8d02a21d64 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.de7607c6-da5e-433b-bd4b-fb2a1bde3575" returned: 0 in 0.441s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1cfc9eb9-3e8d-4417-a25a-bf8d02a21d64 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.de7607c6-da5e-433b-bd4b-fb2a1bde3575 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:22 devstack sudo[108023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.de7607c6-da5e-433b-bd4b-fb2a1bde3575
Nov 07 02:52:22 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:22 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a9fe9d35-13bd-42f2-b0ec-a56897c6e719 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ad74036e-6e22-4de1-824c-fa77e47e8fd7" returned: 0 in 0.342s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:22 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a9fe9d35-13bd-42f2-b0ec-a56897c6e719 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-ad74036e-6e22-4de1-824c-fa77e47e8fd7" released by "delete_volume" :: held 0.930s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:22 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-a9fe9d35-13bd-42f2-b0ec-a56897c6e719 tempest-ProjectMemberTests-1907878748 None] Created reservations ['31b4c185-bd58-469d-a9cf-9292b8e41421', 'd6f46948-469a-4daa-b1c6-e1c9e004c1d4', '8166dca8-5d80-442c-b4f8-157433d84a15', 'b760a39b-541e-42e7-a2e5-ecd721588971'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:22 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1cfc9eb9-3e8d-4417-a25a-bf8d02a21d64 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b.de7607c6-da5e-433b-bd4b-fb2a1bde3575" returned: 0 in 0.300s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:22 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1cfc9eb9-3e8d-4417-a25a-bf8d02a21d64 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-de7607c6-da5e-433b-bd4b-fb2a1bde3575" released by "_delete_snapshot" :: held 1.871s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:22 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1cfc9eb9-3e8d-4417-a25a-bf8d02a21d64 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-edd8bdb4-23cf-43d4-a340-1a741ece1b1b" released by "delete_snapshot" :: held 1.914s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a9fe9d35-13bd-42f2-b0ec-a56897c6e719 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a9fe9d35-13bd-42f2-b0ec-a56897c6e719 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a9fe9d35-13bd-42f2-b0ec-a56897c6e719 tempest-ProjectMemberTests-1907878748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a9fe9d35-13bd-42f2-b0ec-a56897c6e719 tempest-ProjectMemberTests-1907878748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a9fe9d35-13bd-42f2-b0ec-a56897c6e719 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a9fe9d35-13bd-42f2-b0ec-a56897c6e719 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:23 devstack sudo[108027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:52:23 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:23 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-1cfc9eb9-3e8d-4417-a25a-bf8d02a21d64 tempest-ProjectReaderTests-1512630701 None] Created reservations ['c41d8e78-f63b-4525-a3e4-afb4f1854c51', '6336a788-1156-469c-8376-12451c7a28dc', 'cabcc52d-16e4-4d8e-8727-3104927bb5a8', '6a2a48bf-7849-428e-90bc-4c5435bb7d72'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:23 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-1cfc9eb9-3e8d-4417-a25a-bf8d02a21d64 tempest-ProjectReaderTests-1512630701 None] Delete snapshot completed successfully.
Nov 07 02:52:23 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-1cfc9eb9-3e8d-4417-a25a-bf8d02a21d64 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-de7607c6-da5e-433b-bd4b-fb2a1bde3575-delete_snapshot" released by "delete_snapshot" :: held 2.264s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:23 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a9fe9d35-13bd-42f2-b0ec-a56897c6e719 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.335s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:23 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-a9fe9d35-13bd-42f2-b0ec-a56897c6e719 tempest-ProjectMemberTests-1907878748 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:23 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-a9fe9d35-13bd-42f2-b0ec-a56897c6e719 tempest-ProjectMemberTests-1907878748 None] Deleted volume successfully.
Nov 07 02:52:23 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a9fe9d35-13bd-42f2-b0ec-a56897c6e719 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-ad74036e-6e22-4de1-824c-fa77e47e8fd7-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8615bd45-3544-47af-a191-7ee5435927be tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-edd8bdb4-23cf-43d4-a340-1a741ece1b1b-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8615bd45-3544-47af-a191-7ee5435927be tempest-ProjectReaderTests-1512630701 None] Lock "cinder-edd8bdb4-23cf-43d4-a340-1a741ece1b1b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8615bd45-3544-47af-a191-7ee5435927be tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-quobyte-edd8bdb4-23cf-43d4-a340-1a741ece1b1b" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8615bd45-3544-47af-a191-7ee5435927be tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-edd8bdb4-23cf-43d4-a340-1a741ece1b1b" acquired by "delete_volume" :: waited 0.025s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4950b9-f876-4d62-b6fb-a6a34c73fd81]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8615bd45-3544-47af-a191-7ee5435927be tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:24 devstack sudo[108030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b
Nov 07 02:52:24 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Flow 'volume_create_manager' (79cb92ce-4ac8-4d73-8d5a-8fb6c84cfc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9978ec1-91d0-433f-a22f-ec0b7ceafd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9978ec1-91d0-433f-a22f-ec0b7ceafd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1886990713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90854e8da8b14aa28568e8beba706c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:25Z,use_quota=True,user_id='813ad50b030d4d3fac7f68412673b863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31fca23-7655-4e15-bb08-0403e96df7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31fca23-7655-4e15-bb08-0403e96df7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7846f7bb-60da-4aac-8e71-f5526e3fb57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7846f7bb-60da-4aac-8e71-f5526e3fb57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c', 'volume_name': 'volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb386b8c-986c-421a-be24-2c2b2c0c9811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb386b8c-986c-421a-be24-2c2b2c0c9811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b4f121-3f1f-4e83-9ed0-5eb7b7b9d2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:24 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Volume 2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c', 'volume_size': 1}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1886990713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90854e8da8b14aa28568e8beba706c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:25Z,use_quota=True,user_id='813ad50b030d4d3fac7f68412673b863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Creating volume 2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:24 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:24 devstack sudo[108034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c 1073741824
Nov 07 02:52:24 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:24 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8615bd45-3544-47af-a191-7ee5435927be tempest-ProjectReaderTests-1512630701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b" returned: 0 in 0.431s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8615bd45-3544-47af-a191-7ee5435927be tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:24 devstack sudo[108037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b
Nov 07 02:52:24 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:25 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8615bd45-3544-47af-a191-7ee5435927be tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-edd8bdb4-23cf-43d4-a340-1a741ece1b1b" returned: 0 in 0.263s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8615bd45-3544-47af-a191-7ee5435927be tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-edd8bdb4-23cf-43d4-a340-1a741ece1b1b" released by "delete_volume" :: held 0.780s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:25 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-8615bd45-3544-47af-a191-7ee5435927be tempest-ProjectReaderTests-1512630701 None] Created reservations ['3dd2bea5-17ca-4e7b-a880-e1e7c96ad948', '9eefbf3c-14d1-453a-bc8d-e3c9fdf73efa', '97ac1412-cfc1-4008-aa27-e0e987cd564e', 'c8ed56cb-3346-4c29-86d9-faf13fb53ee4'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8615bd45-3544-47af-a191-7ee5435927be tempest-ProjectReaderTests-1512630701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8615bd45-3544-47af-a191-7ee5435927be tempest-ProjectReaderTests-1512630701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8615bd45-3544-47af-a191-7ee5435927be tempest-ProjectReaderTests-1512630701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8615bd45-3544-47af-a191-7ee5435927be tempest-ProjectReaderTests-1512630701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8615bd45-3544-47af-a191-7ee5435927be tempest-ProjectReaderTests-1512630701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8615bd45-3544-47af-a191-7ee5435927be tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:25 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c 1073741824" returned: 0 in 0.614s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:25 devstack sudo[108044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:52:25 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:25 devstack sudo[108046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c
Nov 07 02:52:25 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:25 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c" returned: 0 in 0.304s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:25 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b4f121-3f1f-4e83-9ed0-5eb7b7b9d2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c93fd7-e10c-47cb-98ff-caa3a288c07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:25 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Volume volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c (2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c): created successfully
Nov 07 02:52:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c93fd7-e10c-47cb-98ff-caa3a288c07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:25 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Flow 'volume_create_manager' (79cb92ce-4ac8-4d73-8d5a-8fb6c84cfc14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:25 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c63eb1a0-faba-41b9-8ee3-d4767cc82e6f tempest-ProjectMemberTests-1907878748 None] Created volume successfully.
Nov 07 02:52:26 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8615bd45-3544-47af-a191-7ee5435927be tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.616s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-8615bd45-3544-47af-a191-7ee5435927be tempest-ProjectReaderTests-1512630701 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:26 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-8615bd45-3544-47af-a191-7ee5435927be tempest-ProjectReaderTests-1512630701 None] Deleted volume successfully.
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8615bd45-3544-47af-a191-7ee5435927be tempest-ProjectReaderTests-1512630701 None] Lock "cinder-edd8bdb4-23cf-43d4-a340-1a741ece1b1b-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Flow 'volume_create_manager' (215410f2-1062-4721-82ac-81885bb21246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf6d4786-f79f-4522-8ea3-995e773b2d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf6d4786-f79f-4522-8ea3-995e773b2d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1782971198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84adbd21-bf1d-4177-87ec-388b7e558f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561b2b8c4de24651a364c4cb9b1460c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:26Z,use_quota=True,user_id='b507b952edd14904acb6904428c12ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e934b5a-9f87-4101-a258-fe74a09c1cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e934b5a-9f87-4101-a258-fe74a09c1cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bca5f45-6919-4e24-8d87-f65b55a56da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bca5f45-6919-4e24-8d87-f65b55a56da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84adbd21-bf1d-4177-87ec-388b7e558f38', 'volume_name': 'volume-84adbd21-bf1d-4177-87ec-388b7e558f38', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0dda04d-c273-4409-af5f-2203f682ad33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0dda04d-c273-4409-af5f-2203f682ad33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6936b806-c466-4411-9012-d335a6ea2452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:26 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Volume 84adbd21-bf1d-4177-87ec-388b7e558f38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84adbd21-bf1d-4177-87ec-388b7e558f38', 'volume_size': 1}
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1782971198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84adbd21-bf1d-4177-87ec-388b7e558f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561b2b8c4de24651a364c4cb9b1460c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:26Z,use_quota=True,user_id='b507b952edd14904acb6904428c12ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Creating volume 84adbd21-bf1d-4177-87ec-388b7e558f38 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:26 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:52:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:26 devstack sudo[108050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38 1073741824
Nov 07 02:52:26 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:27 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38 1073741824" returned: 0 in 0.703s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a39ade81-ea09-4a83-b171-6b68a03de775 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:27 devstack sudo[108056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38
Nov 07 02:52:27 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Flow 'volume_create_manager' (b823e969-5a85-4a88-bff3-57f1ade7af94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f859c123-7169-4f77-ab1a-b3478dc37ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f859c123-7169-4f77-ab1a-b3478dc37ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1208188544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07001de1-0ed8-4e19-97ca-520ac715d1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f9b11e23084f33b4159effdf0100fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:28Z,use_quota=True,user_id='19515ca7d14144dca50e4a78012a3e55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d699b940-cb78-4b44-a768-2d52d262442d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:27 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d699b940-cb78-4b44-a768-2d52d262442d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e1674c-1d9d-48db-b074-9fbbbc65cd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e1674c-1d9d-48db-b074-9fbbbc65cd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07001de1-0ed8-4e19-97ca-520ac715d1c8', 'volume_name': 'volume-07001de1-0ed8-4e19-97ca-520ac715d1c8', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50e504f-51ec-42fb-874d-c1c9ea1ce845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50e504f-51ec-42fb-874d-c1c9ea1ce845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffa3a80-fe0c-4233-8821-90406db9a2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:27 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Volume 07001de1-0ed8-4e19-97ca-520ac715d1c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07001de1-0ed8-4e19-97ca-520ac715d1c8', 'volume_size': 1}
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38" returned: 0 in 0.301s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a39ade81-ea09-4a83-b171-6b68a03de775 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.341s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6936b806-c466-4411-9012-d335a6ea2452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84adbd21-bf1d-4177-87ec-388b7e558f38', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2fde7bc-b00e-4deb-9fa9-fda2c4a9b404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-a39ade81-ea09-4a83-b171-6b68a03de775 tempest-ProjectMemberTests-1907878748 None] Creating offline snapshot 0397dd08-e492-46c3-b64e-afb0121bab44 of volume 2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:52:27 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Volume volume-84adbd21-bf1d-4177-87ec-388b7e558f38 (84adbd21-bf1d-4177-87ec-388b7e558f38): created successfully
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2fde7bc-b00e-4deb-9fa9-fda2c4a9b404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Flow 'volume_create_manager' (215410f2-1062-4721-82ac-81885bb21246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f481d23-7998-453d-a70c-65e2cdce05a2]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:27 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a39ade81-ea09-4a83-b171-6b68a03de775 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:27 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-61093069-7d8e-4027-a002-4a941ba5049e tempest-ProjectReaderTests-1512630701 None] Created volume successfully.
Nov 07 02:52:27 devstack sudo[108059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c
Nov 07 02:52:27 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:28 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a39ade81-ea09-4a83-b171-6b68a03de775 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c" returned: 0 in 0.390s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a39ade81-ea09-4a83-b171-6b68a03de775 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.0397dd08-e492-46c3-b64e-afb0121bab44 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:28 devstack sudo[108064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.0397dd08-e492-46c3-b64e-afb0121bab44 1G
Nov 07 02:52:28 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:28 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a39ade81-ea09-4a83-b171-6b68a03de775 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.0397dd08-e492-46c3-b64e-afb0121bab44 1G" returned: 0 in 0.513s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a39ade81-ea09-4a83-b171-6b68a03de775 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.0397dd08-e492-46c3-b64e-afb0121bab44 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c824ae4d-fe24-4b0b-9a8a-eb0909557e7a tempest-ProjectReaderTests-1512630701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:28 devstack sudo[108071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.0397dd08-e492-46c3-b64e-afb0121bab44
Nov 07 02:52:28 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:28 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a39ade81-ea09-4a83-b171-6b68a03de775 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.0397dd08-e492-46c3-b64e-afb0121bab44" returned: 0 in 0.296s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:28 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-a39ade81-ea09-4a83-b171-6b68a03de775 tempest-ProjectMemberTests-1907878748 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.0397dd08-e492-46c3-b64e-afb0121bab44 is being set with open permissions: ugo+rw
Nov 07 02:52:28 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a39ade81-ea09-4a83-b171-6b68a03de775 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.0397dd08-e492-46c3-b64e-afb0121bab44 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:28 devstack sudo[108076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.0397dd08-e492-46c3-b64e-afb0121bab44
Nov 07 02:52:28 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:29 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a39ade81-ea09-4a83-b171-6b68a03de775 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.0397dd08-e492-46c3-b64e-afb0121bab44" returned: 0 in 0.257s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a39ade81-ea09-4a83-b171-6b68a03de775 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:29 devstack sudo[108079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.info
Nov 07 02:52:29 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:29 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a39ade81-ea09-4a83-b171-6b68a03de775 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.info" returned: 0 in 0.283s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:29 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-a39ade81-ea09-4a83-b171-6b68a03de775 tempest-ProjectMemberTests-1907878748 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.info is being set with open permissions: ugo+rw
Nov 07 02:52:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a39ade81-ea09-4a83-b171-6b68a03de775 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:29 devstack sudo[108083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.info
Nov 07 02:52:29 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:29 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a39ade81-ea09-4a83-b171-6b68a03de775 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.info" returned: 0 in 0.268s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a39ade81-ea09-4a83-b171-6b68a03de775 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.129s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.138s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1208188544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07001de1-0ed8-4e19-97ca-520ac715d1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f9b11e23084f33b4159effdf0100fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:28Z,use_quota=True,user_id='19515ca7d14144dca50e4a78012a3e55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Creating volume 07001de1-0ed8-4e19-97ca-520ac715d1c8 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:29 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:29 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:52:29 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:29 devstack sudo[108086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8 1073741824
Nov 07 02:52:29 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:29 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-a39ade81-ea09-4a83-b171-6b68a03de775 tempest-ProjectMemberTests-1907878748 None] Create snapshot completed successfully
Nov 07 02:52:30 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8 1073741824" returned: 0 in 0.453s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:30 devstack sudo[108091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8
Nov 07 02:52:30 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f5b885ee-9bc9-4611-9c14-6561d97ca59c tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-0397dd08-e492-46c3-b64e-afb0121bab44-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f5b885ee-9bc9-4611-9c14-6561d97ca59c tempest-ProjectMemberTests-1907878748 None] Lock "cinder-0397dd08-e492-46c3-b64e-afb0121bab44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f5b885ee-9bc9-4611-9c14-6561d97ca59c tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f5b885ee-9bc9-4611-9c14-6561d97ca59c tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f5b885ee-9bc9-4611-9c14-6561d97ca59c tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-0397dd08-e492-46c3-b64e-afb0121bab44" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f5b885ee-9bc9-4611-9c14-6561d97ca59c tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-0397dd08-e492-46c3-b64e-afb0121bab44" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-f5b885ee-9bc9-4611-9c14-6561d97ca59c tempest-ProjectMemberTests-1907878748 None] Deleting offline snapshot 0397dd08-e492-46c3-b64e-afb0121bab44 of volume 2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-f5b885ee-9bc9-4611-9c14-6561d97ca59c tempest-ProjectMemberTests-1907878748 None] snapshot_file for this snap is: volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.0397dd08-e492-46c3-b64e-afb0121bab44 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdfdb0a-8e8b-4204-886c-aeae6d98181c]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f5b885ee-9bc9-4611-9c14-6561d97ca59c tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.0397dd08-e492-46c3-b64e-afb0121bab44 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:30 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8" returned: 0 in 0.256s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c824ae4d-fe24-4b0b-9a8a-eb0909557e7a tempest-ProjectReaderTests-1512630701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.916s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffa3a80-fe0c-4233-8821-90406db9a2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07001de1-0ed8-4e19-97ca-520ac715d1c8', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f7ca27-6ae5-40cc-b755-d44a154e0108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-c824ae4d-fe24-4b0b-9a8a-eb0909557e7a tempest-ProjectReaderTests-1512630701 None] Creating offline snapshot c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7 of volume 84adbd21-bf1d-4177-87ec-388b7e558f38 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:52:30 devstack sudo[108093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.0397dd08-e492-46c3-b64e-afb0121bab44
Nov 07 02:52:30 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:30 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Volume volume-07001de1-0ed8-4e19-97ca-520ac715d1c8 (07001de1-0ed8-4e19-97ca-520ac715d1c8): created successfully
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f7ca27-6ae5-40cc-b755-d44a154e0108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Flow 'volume_create_manager' (b823e969-5a85-4a88-bff3-57f1ade7af94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[313d7b38-2dd4-4afd-8b89-9ec043850d40]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c824ae4d-fe24-4b0b-9a8a-eb0909557e7a tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:30 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ae8e2ef7-bb47-4e1a-8861-abc9ff6ca100 tempest-SnapshotDependencyTests-201229778 None] Created volume successfully.
Nov 07 02:52:30 devstack sudo[108096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38
Nov 07 02:52:30 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:30 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f5b885ee-9bc9-4611-9c14-6561d97ca59c tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.0397dd08-e492-46c3-b64e-afb0121bab44" returned: 0 in 0.407s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-f5b885ee-9bc9-4611-9c14-6561d97ca59c tempest-ProjectMemberTests-1907878748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c70e20c-b5c7-4603-a133-94653fd2a620]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:30 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f5b885ee-9bc9-4611-9c14-6561d97ca59c tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:31 devstack sudo[108101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c
Nov 07 02:52:31 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:31 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c824ae4d-fe24-4b0b-9a8a-eb0909557e7a tempest-ProjectReaderTests-1512630701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38" returned: 0 in 0.445s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c824ae4d-fe24-4b0b-9a8a-eb0909557e7a tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9fc1ac51-00c5-416c-a427-76dc5c8e2b8e tempest-SnapshotDependencyTests-201229778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:31 devstack sudo[108106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7 1G
Nov 07 02:52:31 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:31 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f5b885ee-9bc9-4611-9c14-6561d97ca59c tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c" returned: 0 in 0.389s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f5b885ee-9bc9-4611-9c14-6561d97ca59c tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.0397dd08-e492-46c3-b64e-afb0121bab44 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:31 devstack sudo[108114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.0397dd08-e492-46c3-b64e-afb0121bab44
Nov 07 02:52:31 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:31 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c824ae4d-fe24-4b0b-9a8a-eb0909557e7a tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7 1G" returned: 0 in 0.445s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c824ae4d-fe24-4b0b-9a8a-eb0909557e7a tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84adbd21-bf1d-4177-87ec-388b7e558f38 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:31 devstack sudo[108117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84adbd21-bf1d-4177-87ec-388b7e558f38 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7
Nov 07 02:52:31 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:31 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f5b885ee-9bc9-4611-9c14-6561d97ca59c tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.0397dd08-e492-46c3-b64e-afb0121bab44" returned: 0 in 0.355s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f5b885ee-9bc9-4611-9c14-6561d97ca59c tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.0397dd08-e492-46c3-b64e-afb0121bab44 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:31 devstack sudo[108122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.0397dd08-e492-46c3-b64e-afb0121bab44
Nov 07 02:52:31 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:31 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c824ae4d-fe24-4b0b-9a8a-eb0909557e7a tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84adbd21-bf1d-4177-87ec-388b7e558f38 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7" returned: 0 in 0.296s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:31 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-c824ae4d-fe24-4b0b-9a8a-eb0909557e7a tempest-ProjectReaderTests-1512630701 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7 is being set with open permissions: ugo+rw
Nov 07 02:52:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c824ae4d-fe24-4b0b-9a8a-eb0909557e7a tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:31 devstack sudo[108127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7
Nov 07 02:52:31 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:31 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:31 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f5b885ee-9bc9-4611-9c14-6561d97ca59c tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c.0397dd08-e492-46c3-b64e-afb0121bab44" returned: 0 in 0.247s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:31 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f5b885ee-9bc9-4611-9c14-6561d97ca59c tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-0397dd08-e492-46c3-b64e-afb0121bab44" released by "_delete_snapshot" :: held 1.521s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f5b885ee-9bc9-4611-9c14-6561d97ca59c tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c" released by "delete_snapshot" :: held 1.543s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:32 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-f5b885ee-9bc9-4611-9c14-6561d97ca59c tempest-ProjectMemberTests-1907878748 None] Created reservations ['4bcaba0d-c6c9-4c0a-a077-c8f3d7c6fa1e', '2c2228f9-3e2f-49cb-9da2-bcf1a9bbcfd3', '8cbd42c4-32b9-41a8-b0d5-21fd18950a5f', '817ba036-f0de-4c08-ab88-2fb4fb768e43'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:32 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f5b885ee-9bc9-4611-9c14-6561d97ca59c tempest-ProjectMemberTests-1907878748 None] Delete snapshot completed successfully.
Nov 07 02:52:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f5b885ee-9bc9-4611-9c14-6561d97ca59c tempest-ProjectMemberTests-1907878748 None] Lock "cinder-0397dd08-e492-46c3-b64e-afb0121bab44-delete_snapshot" released by "delete_snapshot" :: held 1.685s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:32 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c824ae4d-fe24-4b0b-9a8a-eb0909557e7a tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7" returned: 0 in 0.287s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c824ae4d-fe24-4b0b-9a8a-eb0909557e7a tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:32 devstack sudo[108131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.info
Nov 07 02:52:32 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:32 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c824ae4d-fe24-4b0b-9a8a-eb0909557e7a tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.info" returned: 0 in 0.258s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:32 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-c824ae4d-fe24-4b0b-9a8a-eb0909557e7a tempest-ProjectReaderTests-1512630701 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.info is being set with open permissions: ugo+rw
Nov 07 02:52:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c824ae4d-fe24-4b0b-9a8a-eb0909557e7a tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:32 devstack sudo[108134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.info
Nov 07 02:52:32 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-234c8d4b-b274-42ab-978c-2429ed413f77 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-234c8d4b-b274-42ab-978c-2429ed413f77 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-234c8d4b-b274-42ab-978c-2429ed413f77 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:32 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:32 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-234c8d4b-b274-42ab-978c-2429ed413f77 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c" acquired by "delete_volume" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c824ae4d-fe24-4b0b-9a8a-eb0909557e7a tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.info" returned: 0 in 0.292s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c824ae4d-fe24-4b0b-9a8a-eb0909557e7a tempest-ProjectReaderTests-1512630701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.133s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:32 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75f4452-8e4a-4f90-80d7-425dce999649]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9fc1ac51-00c5-416c-a427-76dc5c8e2b8e tempest-SnapshotDependencyTests-201229778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.610s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-234c8d4b-b274-42ab-978c-2429ed413f77 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:32 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-9fc1ac51-00c5-416c-a427-76dc5c8e2b8e tempest-SnapshotDependencyTests-201229778 None] Creating offline snapshot aff60859-673a-4ff2-be52-b8af5f458154 of volume 07001de1-0ed8-4e19-97ca-520ac715d1c8 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:52:32 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c824ae4d-fe24-4b0b-9a8a-eb0909557e7a tempest-ProjectReaderTests-1512630701 None] Create snapshot completed successfully
Nov 07 02:52:32 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f96a734-922f-474e-aaa4-0517d38ab9e8]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:32 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9fc1ac51-00c5-416c-a427-76dc5c8e2b8e tempest-SnapshotDependencyTests-201229778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:32 devstack sudo[108137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c
Nov 07 02:52:32 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:32 devstack sudo[108138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8
Nov 07 02:52:32 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:33 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-234c8d4b-b274-42ab-978c-2429ed413f77 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c" returned: 0 in 0.367s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-234c8d4b-b274-42ab-978c-2429ed413f77 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:33 devstack sudo[108146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c
Nov 07 02:52:33 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:33 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9fc1ac51-00c5-416c-a427-76dc5c8e2b8e tempest-SnapshotDependencyTests-201229778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8" returned: 0 in 0.389s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9fc1ac51-00c5-416c-a427-76dc5c8e2b8e tempest-SnapshotDependencyTests-201229778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.aff60859-673a-4ff2-be52-b8af5f458154 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:33 devstack sudo[108149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.aff60859-673a-4ff2-be52-b8af5f458154 1G
Nov 07 02:52:33 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:33 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-234c8d4b-b274-42ab-978c-2429ed413f77 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c" returned: 0 in 0.264s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-234c8d4b-b274-42ab-978c-2429ed413f77 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c" released by "delete_volume" :: held 0.713s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:33 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-234c8d4b-b274-42ab-978c-2429ed413f77 tempest-ProjectMemberTests-1907878748 None] Created reservations ['2ccc2eec-ef1d-4d50-bf03-8907c0cebeb1', 'f644fca9-0572-4595-a7f8-f5672ff82120', 'd7ea9f0d-c0de-48bb-963a-9e6d56cc74d8', 'df27388b-1146-4cab-9349-8995ab8d079d'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-234c8d4b-b274-42ab-978c-2429ed413f77 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-234c8d4b-b274-42ab-978c-2429ed413f77 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-234c8d4b-b274-42ab-978c-2429ed413f77 tempest-ProjectMemberTests-1907878748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:33 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-234c8d4b-b274-42ab-978c-2429ed413f77 tempest-ProjectMemberTests-1907878748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-234c8d4b-b274-42ab-978c-2429ed413f77 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-234c8d4b-b274-42ab-978c-2429ed413f77 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:33 devstack sudo[108155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:52:33 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:33 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9fc1ac51-00c5-416c-a427-76dc5c8e2b8e tempest-SnapshotDependencyTests-201229778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.aff60859-673a-4ff2-be52-b8af5f458154 1G" returned: 0 in 0.437s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9fc1ac51-00c5-416c-a427-76dc5c8e2b8e tempest-SnapshotDependencyTests-201229778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07001de1-0ed8-4e19-97ca-520ac715d1c8 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.aff60859-673a-4ff2-be52-b8af5f458154 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:33 devstack sudo[108158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07001de1-0ed8-4e19-97ca-520ac715d1c8 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.aff60859-673a-4ff2-be52-b8af5f458154
Nov 07 02:52:33 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:33 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-234c8d4b-b274-42ab-978c-2429ed413f77 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.266s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:33 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-234c8d4b-b274-42ab-978c-2429ed413f77 tempest-ProjectMemberTests-1907878748 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:33 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-234c8d4b-b274-42ab-978c-2429ed413f77 tempest-ProjectMemberTests-1907878748 None] Deleted volume successfully.
Nov 07 02:52:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-234c8d4b-b274-42ab-978c-2429ed413f77 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-2f5bb3e1-df7e-4fc8-b28d-b661fc8aa01c-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:33 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ebbd6afd-945b-4f93-820f-029c898c3154 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9fc1ac51-00c5-416c-a427-76dc5c8e2b8e tempest-SnapshotDependencyTests-201229778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07001de1-0ed8-4e19-97ca-520ac715d1c8 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.aff60859-673a-4ff2-be52-b8af5f458154" returned: 0 in 0.332s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:33 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-9fc1ac51-00c5-416c-a427-76dc5c8e2b8e tempest-SnapshotDependencyTests-201229778 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.aff60859-673a-4ff2-be52-b8af5f458154 is being set with open permissions: ugo+rw
Nov 07 02:52:33 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9fc1ac51-00c5-416c-a427-76dc5c8e2b8e tempest-SnapshotDependencyTests-201229778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.aff60859-673a-4ff2-be52-b8af5f458154 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ebbd6afd-945b-4f93-820f-029c898c3154 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:33 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ebbd6afd-945b-4f93-820f-029c898c3154 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-quobyte-84adbd21-bf1d-4177-87ec-388b7e558f38" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:33 devstack sudo[108165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.aff60859-673a-4ff2-be52-b8af5f458154
Nov 07 02:52:33 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ebbd6afd-945b-4f93-820f-029c898c3154 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-84adbd21-bf1d-4177-87ec-388b7e558f38" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ebbd6afd-945b-4f93-820f-029c898c3154 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-quobyte-c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ebbd6afd-945b-4f93-820f-029c898c3154 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ebbd6afd-945b-4f93-820f-029c898c3154 tempest-ProjectReaderTests-1512630701 None] Deleting offline snapshot c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7 of volume 84adbd21-bf1d-4177-87ec-388b7e558f38 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ebbd6afd-945b-4f93-820f-029c898c3154 tempest-ProjectReaderTests-1512630701 None] snapshot_file for this snap is: volume-84adbd21-bf1d-4177-87ec-388b7e558f38.c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[879dfc96-17f2-411c-8528-c2d93e32888b]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ebbd6afd-945b-4f93-820f-029c898c3154 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:34 devstack sudo[108167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7
Nov 07 02:52:34 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:34 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9fc1ac51-00c5-416c-a427-76dc5c8e2b8e tempest-SnapshotDependencyTests-201229778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.aff60859-673a-4ff2-be52-b8af5f458154" returned: 0 in 0.292s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9fc1ac51-00c5-416c-a427-76dc5c8e2b8e tempest-SnapshotDependencyTests-201229778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:34 devstack sudo[108170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.info
Nov 07 02:52:34 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Flow 'volume_create_manager' (0e0237e1-e7ac-47b1-9e98-89cf1bc342d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2aa3601-eff3-4862-a3eb-30501e242728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2aa3601-eff3-4862-a3eb-30501e242728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1059743154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc907a6-3c07-47ee-b571-5c9a7d71e3ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90854e8da8b14aa28568e8beba706c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:34Z,use_quota=True,user_id='813ad50b030d4d3fac7f68412673b863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0661dcb-c8dc-4f0c-9700-f4448b4f7ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0661dcb-c8dc-4f0c-9700-f4448b4f7ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8882de64-545c-49d5-bba3-37a3207222c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8882de64-545c-49d5-bba3-37a3207222c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afc907a6-3c07-47ee-b571-5c9a7d71e3ed', 'volume_name': 'volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016422e4-caa2-434c-b415-31bcfb840415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016422e4-caa2-434c-b415-31bcfb840415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc526bb4-6c81-49c1-a105-000e0a13c413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:34 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Volume afc907a6-3c07-47ee-b571-5c9a7d71e3ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed', 'volume_size': 1}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:34 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ebbd6afd-945b-4f93-820f-029c898c3154 tempest-ProjectReaderTests-1512630701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7" returned: 0 in 0.418s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ebbd6afd-945b-4f93-820f-029c898c3154 tempest-ProjectReaderTests-1512630701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84adbd21-bf1d-4177-87ec-388b7e558f38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97868d0-3a7e-4468-9a21-70f841a2a624]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ebbd6afd-945b-4f93-820f-029c898c3154 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:34 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9fc1ac51-00c5-416c-a427-76dc5c8e2b8e tempest-SnapshotDependencyTests-201229778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.info" returned: 0 in 0.279s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:34 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-9fc1ac51-00c5-416c-a427-76dc5c8e2b8e tempest-SnapshotDependencyTests-201229778 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.info is being set with open permissions: ugo+rw
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9fc1ac51-00c5-416c-a427-76dc5c8e2b8e tempest-SnapshotDependencyTests-201229778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:34 devstack sudo[108177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.info
Nov 07 02:52:34 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:34 devstack sudo[108176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38
Nov 07 02:52:34 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:34 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-9fc1ac51-00c5-416c-a427-76dc5c8e2b8e tempest-SnapshotDependencyTests-201229778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.info" returned: 0 in 0.248s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-9fc1ac51-00c5-416c-a427-76dc5c8e2b8e tempest-SnapshotDependencyTests-201229778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.111s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.422s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1059743154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc907a6-3c07-47ee-b571-5c9a7d71e3ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90854e8da8b14aa28568e8beba706c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:34Z,use_quota=True,user_id='813ad50b030d4d3fac7f68412673b863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Creating volume afc907a6-3c07-47ee-b571-5c9a7d71e3ed {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:34 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:34 devstack sudo[108183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed 1073741824
Nov 07 02:52:34 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:34 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-9fc1ac51-00c5-416c-a427-76dc5c8e2b8e tempest-SnapshotDependencyTests-201229778 None] Create snapshot completed successfully
Nov 07 02:52:34 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ebbd6afd-945b-4f93-820f-029c898c3154 tempest-ProjectReaderTests-1512630701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38" returned: 0 in 0.392s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:34 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ebbd6afd-945b-4f93-820f-029c898c3154 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:34 devstack sudo[108186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7
Nov 07 02:52:34 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:35 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed 1073741824" returned: 0 in 0.457s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:35 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ebbd6afd-945b-4f93-820f-029c898c3154 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7" returned: 0 in 0.409s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ebbd6afd-945b-4f93-820f-029c898c3154 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:35 devstack sudo[108195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7
Nov 07 02:52:35 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:35 devstack sudo[108196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed
Nov 07 02:52:35 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:35 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ebbd6afd-945b-4f93-820f-029c898c3154 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38.c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7" returned: 0 in 0.282s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:35 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed" returned: 0 in 0.297s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:35 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:35 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ebbd6afd-945b-4f93-820f-029c898c3154 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7" released by "_delete_snapshot" :: held 1.642s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ebbd6afd-945b-4f93-820f-029c898c3154 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-84adbd21-bf1d-4177-87ec-388b7e558f38" released by "delete_snapshot" :: held 1.668s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc526bb4-6c81-49c1-a105-000e0a13c413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ce24b7-7f1e-4949-bed7-18b24df2dfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:35 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Volume volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed (afc907a6-3c07-47ee-b571-5c9a7d71e3ed): created successfully
Nov 07 02:52:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ce24b7-7f1e-4949-bed7-18b24df2dfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Flow 'volume_create_manager' (0e0237e1-e7ac-47b1-9e98-89cf1bc342d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:35 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-d96d43ef-4907-4345-a089-e2f86b97d755 tempest-ProjectMemberTests-1907878748 None] Created volume successfully.
Nov 07 02:52:35 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-ebbd6afd-945b-4f93-820f-029c898c3154 tempest-ProjectReaderTests-1512630701 None] Created reservations ['1de40d6e-5a49-49b2-ade9-1502ce0217dc', 'e2f9ce5c-eee4-4053-aa81-8b7e401ea198', '8dfc1735-be30-4a48-97c5-35c298de32da', '4449f4d3-f185-46de-bdc3-92d33febf807'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:35 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ebbd6afd-945b-4f93-820f-029c898c3154 tempest-ProjectReaderTests-1512630701 None] Delete snapshot completed successfully.
Nov 07 02:52:35 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ebbd6afd-945b-4f93-820f-029c898c3154 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-c5496cb9-a8c1-4b6a-a61e-0d6d9296c6a7-delete_snapshot" released by "delete_snapshot" :: held 1.871s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:35 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Flow 'volume_create_manager' (7087bb44-406c-46e6-bd9f-b43239577a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b51bf5-0110-478b-be1e-8956c66b5b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b51bf5-0110-478b-be1e-8956c66b5b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25ff9bfc-d206-4e12-a3ee-da6108ffe0b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f9b11e23084f33b4159effdf0100fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aff60859-673a-4ff2-be52-b8af5f458154,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:36Z,use_quota=True,user_id='19515ca7d14144dca50e4a78012a3e55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5077fa0-e4a0-4b93-adb2-3c8a69570292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5077fa0-e4a0-4b93-adb2-3c8a69570292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:35 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7779ecfe-1d5c-450b-ad17-8faf2100afd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7779ecfe-1d5c-450b-ad17-8faf2100afd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '25ff9bfc-d206-4e12-a3ee-da6108ffe0b3', 'volume_name': 'volume-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3', 'volume_size': 1, 'snapshot_id': 'aff60859-673a-4ff2-be52-b8af5f458154'}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39517dd-f21f-4332-b81f-ca4a3358e98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39517dd-f21f-4332-b81f-ca4a3358e98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3480b655-227e-4611-bf7d-f252b144fab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:36 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Volume 25ff9bfc-d206-4e12-a3ee-da6108ffe0b3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3', 'volume_size': 1, 'snapshot_id': 'aff60859-673a-4ff2-be52-b8af5f458154'}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Acquiring lock "cinder-quobyte-aff60859-673a-4ff2-be52-b8af5f458154-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3" by "_create_volume_from_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Lock "cinder-quobyte-aff60859-673a-4ff2-be52-b8af5f458154-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Creating volume 25ff9bfc-d206-4e12-a3ee-da6108ffe0b3 from snapshot aff60859-673a-4ff2-be52-b8af5f458154 {{(pid=87054) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Acquiring lock "cinder-quobyte-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3" by "_copy_volume_from_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Lock "cinder-quobyte-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] snapshot: aff60859-673a-4ff2-be52-b8af5f458154, volume: 25ff9bfc-d206-4e12-a3ee-da6108ffe0b3,  {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-31c4034f-1554-4de8-9096-87dfcd2cd272 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-84adbd21-bf1d-4177-87ec-388b7e558f38-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[806dbd0f-8493-4afa-b241-55b34dde9b5b]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.aff60859-673a-4ff2-be52-b8af5f458154 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-31c4034f-1554-4de8-9096-87dfcd2cd272 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-84adbd21-bf1d-4177-87ec-388b7e558f38-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-31c4034f-1554-4de8-9096-87dfcd2cd272 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-quobyte-84adbd21-bf1d-4177-87ec-388b7e558f38" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-31c4034f-1554-4de8-9096-87dfcd2cd272 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-84adbd21-bf1d-4177-87ec-388b7e558f38" acquired by "delete_volume" :: waited 0.021s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[924d7d21-a9e8-4122-ab95-2f9dd4830642]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-31c4034f-1554-4de8-9096-87dfcd2cd272 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:36 devstack sudo[108201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.aff60859-673a-4ff2-be52-b8af5f458154
Nov 07 02:52:36 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:36 devstack sudo[108202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38
Nov 07 02:52:36 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:36 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.aff60859-673a-4ff2-be52-b8af5f458154" returned: 0 in 0.413s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07001de1-0ed8-4e19-97ca-520ac715d1c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[975384ca-3f6b-4d83-b848-f0deac8fc7a7]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-df84df49-e7f5-4e0f-9747-8031eaba5305 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:36 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-31c4034f-1554-4de8-9096-87dfcd2cd272 tempest-ProjectReaderTests-1512630701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38" returned: 0 in 0.399s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-31c4034f-1554-4de8-9096-87dfcd2cd272 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:36 devstack sudo[108212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38
Nov 07 02:52:36 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:36 devstack sudo[108210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8
Nov 07 02:52:36 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:36 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-31c4034f-1554-4de8-9096-87dfcd2cd272 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-84adbd21-bf1d-4177-87ec-388b7e558f38" returned: 0 in 0.252s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-31c4034f-1554-4de8-9096-87dfcd2cd272 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-84adbd21-bf1d-4177-87ec-388b7e558f38" released by "delete_volume" :: held 0.712s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:36 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8" returned: 0 in 0.366s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] will copy from snapshot at /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8 {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Creating direct copy from snapshot {{(pid=87054) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.utils [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Path /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3 not found in is_blk_device check {{(pid=87054) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:36 devstack sudo[108219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3
Nov 07 02:52:36 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:36 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-31c4034f-1554-4de8-9096-87dfcd2cd272 tempest-ProjectReaderTests-1512630701 None] Created reservations ['8ebf8461-7026-4463-97f8-3a7b934e261c', 'f467faab-f584-4d3e-80ca-225791d1dc24', '65392b73-8735-4630-9f85-6064003e2ae3', '65ac1d07-b83d-4419-8cce-a35cb8087bb3'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-31c4034f-1554-4de8-9096-87dfcd2cd272 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-31c4034f-1554-4de8-9096-87dfcd2cd272 tempest-ProjectReaderTests-1512630701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:37 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-31c4034f-1554-4de8-9096-87dfcd2cd272 tempest-ProjectReaderTests-1512630701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:37 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-31c4034f-1554-4de8-9096-87dfcd2cd272 tempest-ProjectReaderTests-1512630701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-31c4034f-1554-4de8-9096-87dfcd2cd272 tempest-ProjectReaderTests-1512630701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-31c4034f-1554-4de8-9096-87dfcd2cd272 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:37 devstack sudo[108221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:52:37 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:37 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:37 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-31c4034f-1554-4de8-9096-87dfcd2cd272 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.259s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:37 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-31c4034f-1554-4de8-9096-87dfcd2cd272 tempest-ProjectReaderTests-1512630701 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:37 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-31c4034f-1554-4de8-9096-87dfcd2cd272 tempest-ProjectReaderTests-1512630701 None] Deleted volume successfully.
Nov 07 02:52:37 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-31c4034f-1554-4de8-9096-87dfcd2cd272 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-84adbd21-bf1d-4177-87ec-388b7e558f38-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:38 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Flow 'volume_create_manager' (10e6dad7-cf9f-4d75-8525-557b0e9aa6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a75defa-27f0-43cc-9890-446cbb87b923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a75defa-27f0-43cc-9890-446cbb87b923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-734924342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532943c5-884d-408c-a750-21f35594185a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561b2b8c4de24651a364c4cb9b1460c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:38Z,use_quota=True,user_id='b507b952edd14904acb6904428c12ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf6d3b2-48c0-40d5-88e8-775ca0894d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf6d3b2-48c0-40d5-88e8-775ca0894d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae920f9-4125-4811-a0bf-b3d82d8672fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae920f9-4125-4811-a0bf-b3d82d8672fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '532943c5-884d-408c-a750-21f35594185a', 'volume_name': 'volume-532943c5-884d-408c-a750-21f35594185a', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ff9de1-abd5-4094-8616-dfc2c2932c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ff9de1-abd5-4094-8616-dfc2c2932c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:38 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c591855-823e-4487-b35e-c822ce6becd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:38 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Volume 532943c5-884d-408c-a750-21f35594185a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-532943c5-884d-408c-a750-21f35594185a', 'volume_size': 1}
Nov 07 02:52:38 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:43 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3" returned: 0 in 6.184s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:43 devstack cinder-volume[87054]: DEBUG cinder.image.image_utils [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Image conversion details: src /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3 {{(pid=87054) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 07 02:52:43 devstack cinder-volume[87054]: INFO cinder.image.image_utils [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Converted 1024.00 MB image at 165.55 MB/s
Nov 07 02:52:43 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3 is being set with open permissions: ugo+rw
Nov 07 02:52:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:43 devstack sudo[108239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3
Nov 07 02:52:43 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:43 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3" returned: 0 in 0.235s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:43 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Lock "cinder-quobyte-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3" released by "_copy_volume_from_snapshot" :: held 7.310s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:43 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Lock "cinder-quobyte-aff60859-673a-4ff2-be52-b8af5f458154-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3" released by "_create_volume_from_snapshot" :: held 7.378s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.393s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-df84df49-e7f5-4e0f-9747-8031eaba5305 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.809s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-df84df49-e7f5-4e0f-9747-8031eaba5305 tempest-ProjectMemberTests-1907878748 None] Creating offline snapshot c1f46291-ef5b-4537-8fe7-0d99fa03728a of volume afc907a6-3c07-47ee-b571-5c9a7d71e3ed {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:52:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3480b655-227e-4611-bf7d-f252b144fab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3', 'volume_size': 1, 'snapshot_id': 'aff60859-673a-4ff2-be52-b8af5f458154'}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b97ac6b4-5e19-4390-b64e-e56c0ee83cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:43 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e28724-8855-4e0d-915b-f758238bc094]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-df84df49-e7f5-4e0f-9747-8031eaba5305 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:43 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Volume volume-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3 (25ff9bfc-d206-4e12-a3ee-da6108ffe0b3): created successfully
Nov 07 02:52:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b97ac6b4-5e19-4390-b64e-e56c0ee83cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Flow 'volume_create_manager' (7087bb44-406c-46e6-bd9f-b43239577a56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:43 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-cafe3fd7-0607-4e38-ba0b-1ef3c5e47b27 tempest-SnapshotDependencyTests-201229778 None] Created volume successfully.
Nov 07 02:52:43 devstack sudo[108242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed
Nov 07 02:52:43 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:43 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-df84df49-e7f5-4e0f-9747-8031eaba5305 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed" returned: 0 in 0.346s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-df84df49-e7f5-4e0f-9747-8031eaba5305 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.c1f46291-ef5b-4537-8fe7-0d99fa03728a 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:43 devstack sudo[108247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.c1f46291-ef5b-4537-8fe7-0d99fa03728a 1G
Nov 07 02:52:43 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:44 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-df84df49-e7f5-4e0f-9747-8031eaba5305 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.c1f46291-ef5b-4537-8fe7-0d99fa03728a 1G" returned: 0 in 0.392s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-df84df49-e7f5-4e0f-9747-8031eaba5305 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.c1f46291-ef5b-4537-8fe7-0d99fa03728a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:44 devstack sudo[108252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.c1f46291-ef5b-4537-8fe7-0d99fa03728a
Nov 07 02:52:44 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:44 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-df84df49-e7f5-4e0f-9747-8031eaba5305 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.c1f46291-ef5b-4537-8fe7-0d99fa03728a" returned: 0 in 0.284s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:44 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-df84df49-e7f5-4e0f-9747-8031eaba5305 tempest-ProjectMemberTests-1907878748 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.c1f46291-ef5b-4537-8fe7-0d99fa03728a is being set with open permissions: ugo+rw
Nov 07 02:52:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-df84df49-e7f5-4e0f-9747-8031eaba5305 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.c1f46291-ef5b-4537-8fe7-0d99fa03728a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:44 devstack sudo[108258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.c1f46291-ef5b-4537-8fe7-0d99fa03728a
Nov 07 02:52:44 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c39e16f3-0a9f-4295-a73e-c6991987b72d tempest-SnapshotDependencyTests-201229778 None] Acquiring lock "cinder-aff60859-673a-4ff2-be52-b8af5f458154-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c39e16f3-0a9f-4295-a73e-c6991987b72d tempest-SnapshotDependencyTests-201229778 None] Lock "cinder-aff60859-673a-4ff2-be52-b8af5f458154-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c39e16f3-0a9f-4295-a73e-c6991987b72d tempest-SnapshotDependencyTests-201229778 None] Acquiring lock "cinder-quobyte-07001de1-0ed8-4e19-97ca-520ac715d1c8" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c39e16f3-0a9f-4295-a73e-c6991987b72d tempest-SnapshotDependencyTests-201229778 None] Lock "cinder-quobyte-07001de1-0ed8-4e19-97ca-520ac715d1c8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c39e16f3-0a9f-4295-a73e-c6991987b72d tempest-SnapshotDependencyTests-201229778 None] Acquiring lock "cinder-quobyte-aff60859-673a-4ff2-be52-b8af5f458154" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c39e16f3-0a9f-4295-a73e-c6991987b72d tempest-SnapshotDependencyTests-201229778 None] Lock "cinder-quobyte-aff60859-673a-4ff2-be52-b8af5f458154" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-c39e16f3-0a9f-4295-a73e-c6991987b72d tempest-SnapshotDependencyTests-201229778 None] Deleting offline snapshot aff60859-673a-4ff2-be52-b8af5f458154 of volume 07001de1-0ed8-4e19-97ca-520ac715d1c8 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:52:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-c39e16f3-0a9f-4295-a73e-c6991987b72d tempest-SnapshotDependencyTests-201229778 None] snapshot_file for this snap is: volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.aff60859-673a-4ff2-be52-b8af5f458154 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:52:44 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3fbfb3-8633-4aa2-bb34-5dd0a48cec0b]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c39e16f3-0a9f-4295-a73e-c6991987b72d tempest-SnapshotDependencyTests-201229778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.aff60859-673a-4ff2-be52-b8af5f458154 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:44 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-df84df49-e7f5-4e0f-9747-8031eaba5305 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.c1f46291-ef5b-4537-8fe7-0d99fa03728a" returned: 0 in 0.246s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-df84df49-e7f5-4e0f-9747-8031eaba5305 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:44 devstack sudo[108262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.info
Nov 07 02:52:44 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:44 devstack sudo[108261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.aff60859-673a-4ff2-be52-b8af5f458154
Nov 07 02:52:44 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:45 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-df84df49-e7f5-4e0f-9747-8031eaba5305 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.info" returned: 0 in 0.254s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:45 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-df84df49-e7f5-4e0f-9747-8031eaba5305 tempest-ProjectMemberTests-1907878748 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.info is being set with open permissions: ugo+rw
Nov 07 02:52:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-df84df49-e7f5-4e0f-9747-8031eaba5305 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:45 devstack sudo[108267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.info
Nov 07 02:52:45 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:45 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c39e16f3-0a9f-4295-a73e-c6991987b72d tempest-SnapshotDependencyTests-201229778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.aff60859-673a-4ff2-be52-b8af5f458154" returned: 0 in 0.379s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-c39e16f3-0a9f-4295-a73e-c6991987b72d tempest-SnapshotDependencyTests-201229778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07001de1-0ed8-4e19-97ca-520ac715d1c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:52:45 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d68d77b-40d4-4b87-9253-00c649990d16]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c39e16f3-0a9f-4295-a73e-c6991987b72d tempest-SnapshotDependencyTests-201229778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:45 devstack sudo[108271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8
Nov 07 02:52:45 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:45 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-df84df49-e7f5-4e0f-9747-8031eaba5305 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.info" returned: 0 in 0.267s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-df84df49-e7f5-4e0f-9747-8031eaba5305 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.155s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-734924342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532943c5-884d-408c-a750-21f35594185a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561b2b8c4de24651a364c4cb9b1460c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:38Z,use_quota=True,user_id='b507b952edd14904acb6904428c12ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Creating volume 532943c5-884d-408c-a750-21f35594185a {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:45 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:52:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:45 devstack sudo[108274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a 1073741824
Nov 07 02:52:45 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:45 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-df84df49-e7f5-4e0f-9747-8031eaba5305 tempest-ProjectMemberTests-1907878748 None] Create snapshot completed successfully
Nov 07 02:52:45 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c39e16f3-0a9f-4295-a73e-c6991987b72d tempest-SnapshotDependencyTests-201229778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8" returned: 0 in 0.548s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c39e16f3-0a9f-4295-a73e-c6991987b72d tempest-SnapshotDependencyTests-201229778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.aff60859-673a-4ff2-be52-b8af5f458154 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:45 devstack sudo[108283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.aff60859-673a-4ff2-be52-b8af5f458154
Nov 07 02:52:45 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:45 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a 1073741824" returned: 0 in 0.455s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:45 devstack sudo[108285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a
Nov 07 02:52:45 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:46 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c39e16f3-0a9f-4295-a73e-c6991987b72d tempest-SnapshotDependencyTests-201229778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.aff60859-673a-4ff2-be52-b8af5f458154" returned: 0 in 0.360s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c39e16f3-0a9f-4295-a73e-c6991987b72d tempest-SnapshotDependencyTests-201229778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.aff60859-673a-4ff2-be52-b8af5f458154 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:46 devstack sudo[108291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.aff60859-673a-4ff2-be52-b8af5f458154
Nov 07 02:52:46 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:46 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a" returned: 0 in 0.271s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ff3a9b2d-fea7-49be-b25d-aa674f37157e tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-c1f46291-ef5b-4537-8fe7-0d99fa03728a-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c591855-823e-4487-b35e-c822ce6becd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-532943c5-884d-408c-a750-21f35594185a', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807ae8eb-d517-429b-84f9-8ce497c01319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ff3a9b2d-fea7-49be-b25d-aa674f37157e tempest-ProjectMemberTests-1907878748 None] Lock "cinder-c1f46291-ef5b-4537-8fe7-0d99fa03728a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ff3a9b2d-fea7-49be-b25d-aa674f37157e tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-afc907a6-3c07-47ee-b571-5c9a7d71e3ed" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:46 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Volume volume-532943c5-884d-408c-a750-21f35594185a (532943c5-884d-408c-a750-21f35594185a): created successfully
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807ae8eb-d517-429b-84f9-8ce497c01319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Flow 'volume_create_manager' (10e6dad7-cf9f-4d75-8525-557b0e9aa6eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ff3a9b2d-fea7-49be-b25d-aa674f37157e tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-afc907a6-3c07-47ee-b571-5c9a7d71e3ed" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ff3a9b2d-fea7-49be-b25d-aa674f37157e tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-c1f46291-ef5b-4537-8fe7-0d99fa03728a" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:46 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-beab57b4-4418-4d43-a6ce-f3c1a3b2b365 tempest-ProjectReaderTests-1512630701 None] Created volume successfully.
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ff3a9b2d-fea7-49be-b25d-aa674f37157e tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-c1f46291-ef5b-4537-8fe7-0d99fa03728a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ff3a9b2d-fea7-49be-b25d-aa674f37157e tempest-ProjectMemberTests-1907878748 None] Deleting offline snapshot c1f46291-ef5b-4537-8fe7-0d99fa03728a of volume afc907a6-3c07-47ee-b571-5c9a7d71e3ed {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ff3a9b2d-fea7-49be-b25d-aa674f37157e tempest-ProjectMemberTests-1907878748 None] snapshot_file for this snap is: volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.c1f46291-ef5b-4537-8fe7-0d99fa03728a {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[572cf3cd-6426-435f-ba9c-9b074622661f]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff3a9b2d-fea7-49be-b25d-aa674f37157e tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.c1f46291-ef5b-4537-8fe7-0d99fa03728a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:46 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c39e16f3-0a9f-4295-a73e-c6991987b72d tempest-SnapshotDependencyTests-201229778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8.aff60859-673a-4ff2-be52-b8af5f458154" returned: 0 in 0.299s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:46 devstack sudo[108293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.c1f46291-ef5b-4537-8fe7-0d99fa03728a
Nov 07 02:52:46 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c39e16f3-0a9f-4295-a73e-c6991987b72d tempest-SnapshotDependencyTests-201229778 None] Lock "cinder-quobyte-aff60859-673a-4ff2-be52-b8af5f458154" released by "_delete_snapshot" :: held 1.720s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c39e16f3-0a9f-4295-a73e-c6991987b72d tempest-SnapshotDependencyTests-201229778 None] Lock "cinder-quobyte-07001de1-0ed8-4e19-97ca-520ac715d1c8" released by "delete_snapshot" :: held 1.750s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-c39e16f3-0a9f-4295-a73e-c6991987b72d tempest-SnapshotDependencyTests-201229778 None] Created reservations ['cdc2d880-28ef-4b25-b0bd-26e9c3eea05e', 'cf32e279-d45e-41af-b4d8-a2c1482fe5dc', '548be8c7-b045-41dd-981f-24a8cc43f050', '6705f61c-6536-4aee-83b4-bfde1ae3d447'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:46 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c39e16f3-0a9f-4295-a73e-c6991987b72d tempest-SnapshotDependencyTests-201229778 None] Delete snapshot completed successfully.
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c39e16f3-0a9f-4295-a73e-c6991987b72d tempest-SnapshotDependencyTests-201229778 None] Lock "cinder-aff60859-673a-4ff2-be52-b8af5f458154-delete_snapshot" released by "delete_snapshot" :: held 1.897s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b2454330-d3c7-4180-8f1b-1d5d74e25f54 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b2454330-d3c7-4180-8f1b-1d5d74e25f54 tempest-ProjectReaderTests-1512630701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-b2454330-d3c7-4180-8f1b-1d5d74e25f54 tempest-ProjectReaderTests-1512630701 None] Creating offline snapshot 5296712c-0ee7-49ce-86b1-0ad81458c711 of volume 532943c5-884d-408c-a750-21f35594185a {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:52:46 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff3a9b2d-fea7-49be-b25d-aa674f37157e tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.c1f46291-ef5b-4537-8fe7-0d99fa03728a" returned: 0 in 0.417s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ff3a9b2d-fea7-49be-b25d-aa674f37157e tempest-ProjectMemberTests-1907878748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[85edf3c5-a7ea-4336-8ea9-2bd0d55d4d5b]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b2454330-d3c7-4180-8f1b-1d5d74e25f54 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[3058e0b3-775d-4767-bf7b-f4651dc9f56a]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff3a9b2d-fea7-49be-b25d-aa674f37157e tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:46 devstack sudo[108300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a
Nov 07 02:52:46 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-955fecab-4367-4b87-be84-76729e373b15 tempest-SnapshotDependencyTests-201229778 None] Acquiring lock "cinder-07001de1-0ed8-4e19-97ca-520ac715d1c8-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:46 devstack sudo[108301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-955fecab-4367-4b87-be84-76729e373b15 tempest-SnapshotDependencyTests-201229778 None] Lock "cinder-07001de1-0ed8-4e19-97ca-520ac715d1c8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:46 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-955fecab-4367-4b87-be84-76729e373b15 tempest-SnapshotDependencyTests-201229778 None] Acquiring lock "cinder-quobyte-07001de1-0ed8-4e19-97ca-520ac715d1c8" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-955fecab-4367-4b87-be84-76729e373b15 tempest-SnapshotDependencyTests-201229778 None] Lock "cinder-quobyte-07001de1-0ed8-4e19-97ca-520ac715d1c8" acquired by "delete_volume" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[63418448-e671-4881-bd7f-34c19c71fbae]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-955fecab-4367-4b87-be84-76729e373b15 tempest-SnapshotDependencyTests-201229778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:47 devstack sudo[108304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8
Nov 07 02:52:47 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:47 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b2454330-d3c7-4180-8f1b-1d5d74e25f54 tempest-ProjectReaderTests-1512630701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a" returned: 0 in 0.401s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b2454330-d3c7-4180-8f1b-1d5d74e25f54 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.5296712c-0ee7-49ce-86b1-0ad81458c711 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:47 devstack sudo[108312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.5296712c-0ee7-49ce-86b1-0ad81458c711 1G
Nov 07 02:52:47 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:47 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff3a9b2d-fea7-49be-b25d-aa674f37157e tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed" returned: 0 in 0.424s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff3a9b2d-fea7-49be-b25d-aa674f37157e tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.c1f46291-ef5b-4537-8fe7-0d99fa03728a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:47 devstack sudo[108314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.c1f46291-ef5b-4537-8fe7-0d99fa03728a
Nov 07 02:52:47 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:47 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-955fecab-4367-4b87-be84-76729e373b15 tempest-SnapshotDependencyTests-201229778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8" returned: 0 in 0.417s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-955fecab-4367-4b87-be84-76729e373b15 tempest-SnapshotDependencyTests-201229778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:47 devstack sudo[108324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8
Nov 07 02:52:47 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:47 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff3a9b2d-fea7-49be-b25d-aa674f37157e tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.c1f46291-ef5b-4537-8fe7-0d99fa03728a" returned: 0 in 0.366s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff3a9b2d-fea7-49be-b25d-aa674f37157e tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.c1f46291-ef5b-4537-8fe7-0d99fa03728a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:47 devstack sudo[108327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.c1f46291-ef5b-4537-8fe7-0d99fa03728a
Nov 07 02:52:47 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:47 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b2454330-d3c7-4180-8f1b-1d5d74e25f54 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.5296712c-0ee7-49ce-86b1-0ad81458c711 1G" returned: 0 in 0.443s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b2454330-d3c7-4180-8f1b-1d5d74e25f54 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532943c5-884d-408c-a750-21f35594185a -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.5296712c-0ee7-49ce-86b1-0ad81458c711 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:47 devstack sudo[108329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532943c5-884d-408c-a750-21f35594185a -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.5296712c-0ee7-49ce-86b1-0ad81458c711
Nov 07 02:52:47 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:47 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-955fecab-4367-4b87-be84-76729e373b15 tempest-SnapshotDependencyTests-201229778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-07001de1-0ed8-4e19-97ca-520ac715d1c8" returned: 0 in 0.268s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-955fecab-4367-4b87-be84-76729e373b15 tempest-SnapshotDependencyTests-201229778 None] Lock "cinder-quobyte-07001de1-0ed8-4e19-97ca-520ac715d1c8" released by "delete_volume" :: held 0.767s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-955fecab-4367-4b87-be84-76729e373b15 tempest-SnapshotDependencyTests-201229778 None] Created reservations ['733da934-c037-4eaa-b56d-a45c6874388d', 'c7adbd6d-bce4-41e3-9a84-20af3e829c68', '36487cf6-a631-4d6d-8ecc-07cfbfa886a5', '9b6e7e66-09a5-4855-9c0e-a2d1858a61fa'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-955fecab-4367-4b87-be84-76729e373b15 tempest-SnapshotDependencyTests-201229778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-955fecab-4367-4b87-be84-76729e373b15 tempest-SnapshotDependencyTests-201229778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-955fecab-4367-4b87-be84-76729e373b15 tempest-SnapshotDependencyTests-201229778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-955fecab-4367-4b87-be84-76729e373b15 tempest-SnapshotDependencyTests-201229778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-955fecab-4367-4b87-be84-76729e373b15 tempest-SnapshotDependencyTests-201229778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-955fecab-4367-4b87-be84-76729e373b15 tempest-SnapshotDependencyTests-201229778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:47 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ff3a9b2d-fea7-49be-b25d-aa674f37157e tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed.c1f46291-ef5b-4537-8fe7-0d99fa03728a" returned: 0 in 0.309s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:47 devstack sudo[108336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:52:47 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ff3a9b2d-fea7-49be-b25d-aa674f37157e tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-c1f46291-ef5b-4537-8fe7-0d99fa03728a" released by "_delete_snapshot" :: held 1.630s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ff3a9b2d-fea7-49be-b25d-aa674f37157e tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-afc907a6-3c07-47ee-b571-5c9a7d71e3ed" released by "delete_snapshot" :: held 1.662s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:47 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b2454330-d3c7-4180-8f1b-1d5d74e25f54 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532943c5-884d-408c-a750-21f35594185a -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.5296712c-0ee7-49ce-86b1-0ad81458c711" returned: 0 in 0.321s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:47 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-b2454330-d3c7-4180-8f1b-1d5d74e25f54 tempest-ProjectReaderTests-1512630701 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.5296712c-0ee7-49ce-86b1-0ad81458c711 is being set with open permissions: ugo+rw
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b2454330-d3c7-4180-8f1b-1d5d74e25f54 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.5296712c-0ee7-49ce-86b1-0ad81458c711 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:47 devstack sudo[108339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.5296712c-0ee7-49ce-86b1-0ad81458c711
Nov 07 02:52:47 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-ff3a9b2d-fea7-49be-b25d-aa674f37157e tempest-ProjectMemberTests-1907878748 None] Created reservations ['e9218753-04c0-45e3-838d-e15c459d11ee', '48da5747-f460-4cfa-a240-53cffbc66093', '94ca9f88-458f-4648-af2a-c35633b3b38a', '3f21829f-e97f-4325-9f84-8d33660999c2'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f3d149d5-b206-48a0-9a17-db71b695754f tempest-SnapshotDependencyTests-201229778 None] Acquiring lock "cinder-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f3d149d5-b206-48a0-9a17-db71b695754f tempest-SnapshotDependencyTests-201229778 None] Lock "cinder-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:48 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-955fecab-4367-4b87-be84-76729e373b15 tempest-SnapshotDependencyTests-201229778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.270s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-955fecab-4367-4b87-be84-76729e373b15 tempest-SnapshotDependencyTests-201229778 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f3d149d5-b206-48a0-9a17-db71b695754f tempest-SnapshotDependencyTests-201229778 None] Acquiring lock "cinder-quobyte-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:48 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ff3a9b2d-fea7-49be-b25d-aa674f37157e tempest-ProjectMemberTests-1907878748 None] Delete snapshot completed successfully.
Nov 07 02:52:48 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-955fecab-4367-4b87-be84-76729e373b15 tempest-SnapshotDependencyTests-201229778 None] Deleted volume successfully.
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ff3a9b2d-fea7-49be-b25d-aa674f37157e tempest-ProjectMemberTests-1907878748 None] Lock "cinder-c1f46291-ef5b-4537-8fe7-0d99fa03728a-delete_snapshot" released by "delete_snapshot" :: held 1.930s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f3d149d5-b206-48a0-9a17-db71b695754f tempest-SnapshotDependencyTests-201229778 None] Lock "cinder-quobyte-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3" acquired by "delete_volume" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-955fecab-4367-4b87-be84-76729e373b15 tempest-SnapshotDependencyTests-201229778 None] Lock "cinder-07001de1-0ed8-4e19-97ca-520ac715d1c8-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4a7759-69d6-4eaa-b016-23a16097b8bb]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f3d149d5-b206-48a0-9a17-db71b695754f tempest-SnapshotDependencyTests-201229778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:48 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b2454330-d3c7-4180-8f1b-1d5d74e25f54 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.5296712c-0ee7-49ce-86b1-0ad81458c711" returned: 0 in 0.299s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b2454330-d3c7-4180-8f1b-1d5d74e25f54 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:48 devstack sudo[108344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.info
Nov 07 02:52:48 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:48 devstack sudo[108343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3
Nov 07 02:52:48 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0ae2d0ae-fd50-438e-a007-d63b77fb8f99 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-afc907a6-3c07-47ee-b571-5c9a7d71e3ed-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0ae2d0ae-fd50-438e-a007-d63b77fb8f99 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-afc907a6-3c07-47ee-b571-5c9a7d71e3ed-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0ae2d0ae-fd50-438e-a007-d63b77fb8f99 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-afc907a6-3c07-47ee-b571-5c9a7d71e3ed" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0ae2d0ae-fd50-438e-a007-d63b77fb8f99 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-afc907a6-3c07-47ee-b571-5c9a7d71e3ed" acquired by "delete_volume" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[70784e1b-409b-4aba-818d-5a6e29209a44]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0ae2d0ae-fd50-438e-a007-d63b77fb8f99 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:48 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b2454330-d3c7-4180-8f1b-1d5d74e25f54 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.info" returned: 0 in 0.311s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:48 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-b2454330-d3c7-4180-8f1b-1d5d74e25f54 tempest-ProjectReaderTests-1512630701 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.info is being set with open permissions: ugo+rw
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b2454330-d3c7-4180-8f1b-1d5d74e25f54 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:48 devstack sudo[108353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.info
Nov 07 02:52:48 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:48 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f3d149d5-b206-48a0-9a17-db71b695754f tempest-SnapshotDependencyTests-201229778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3" returned: 0 in 0.412s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f3d149d5-b206-48a0-9a17-db71b695754f tempest-SnapshotDependencyTests-201229778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:48 devstack sudo[108348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed
Nov 07 02:52:48 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:48 devstack sudo[108355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3
Nov 07 02:52:48 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:48 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b2454330-d3c7-4180-8f1b-1d5d74e25f54 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.info" returned: 0 in 0.267s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b2454330-d3c7-4180-8f1b-1d5d74e25f54 tempest-ProjectReaderTests-1512630701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.136s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:48 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f3d149d5-b206-48a0-9a17-db71b695754f tempest-SnapshotDependencyTests-201229778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3" returned: 0 in 0.257s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:48 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0ae2d0ae-fd50-438e-a007-d63b77fb8f99 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed" returned: 0 in 0.393s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0ae2d0ae-fd50-438e-a007-d63b77fb8f99 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f3d149d5-b206-48a0-9a17-db71b695754f tempest-SnapshotDependencyTests-201229778 None] Lock "cinder-quobyte-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3" released by "delete_volume" :: held 0.737s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:48 devstack sudo[108363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed
Nov 07 02:52:48 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:48 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b2454330-d3c7-4180-8f1b-1d5d74e25f54 tempest-ProjectReaderTests-1512630701 None] Create snapshot completed successfully
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-f3d149d5-b206-48a0-9a17-db71b695754f tempest-SnapshotDependencyTests-201229778 None] Created reservations ['14334d39-5587-47cf-9cfd-8f1871c90300', '974b74aa-1a7f-45f0-ad08-a8bbd4243a4d', '676005b1-3232-45ff-9f5a-41e090e7bc15', '579fc829-4624-489f-bfea-5beda5b89e9e'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f3d149d5-b206-48a0-9a17-db71b695754f tempest-SnapshotDependencyTests-201229778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f3d149d5-b206-48a0-9a17-db71b695754f tempest-SnapshotDependencyTests-201229778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f3d149d5-b206-48a0-9a17-db71b695754f tempest-SnapshotDependencyTests-201229778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f3d149d5-b206-48a0-9a17-db71b695754f tempest-SnapshotDependencyTests-201229778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f3d149d5-b206-48a0-9a17-db71b695754f tempest-SnapshotDependencyTests-201229778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f3d149d5-b206-48a0-9a17-db71b695754f tempest-SnapshotDependencyTests-201229778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:48 devstack sudo[108365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:52:48 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:49 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0ae2d0ae-fd50-438e-a007-d63b77fb8f99 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-afc907a6-3c07-47ee-b571-5c9a7d71e3ed" returned: 0 in 0.252s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0ae2d0ae-fd50-438e-a007-d63b77fb8f99 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-afc907a6-3c07-47ee-b571-5c9a7d71e3ed" released by "delete_volume" :: held 0.718s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:49 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-0ae2d0ae-fd50-438e-a007-d63b77fb8f99 tempest-ProjectMemberTests-1907878748 None] Created reservations ['96ad7d26-8bf7-45c6-a9ea-011958a90de5', '99a834f5-ce1b-4957-a956-b237c1110d5f', 'daf6e4f1-ef94-4f14-8f56-42e1b72fe721', '95a06543-5104-47b9-8c85-c9300c1b2d5f'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:49 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f3d149d5-b206-48a0-9a17-db71b695754f tempest-SnapshotDependencyTests-201229778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.251s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:49 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-f3d149d5-b206-48a0-9a17-db71b695754f tempest-SnapshotDependencyTests-201229778 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:49 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f3d149d5-b206-48a0-9a17-db71b695754f tempest-SnapshotDependencyTests-201229778 None] Deleted volume successfully.
Nov 07 02:52:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0ae2d0ae-fd50-438e-a007-d63b77fb8f99 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0ae2d0ae-fd50-438e-a007-d63b77fb8f99 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:49 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0ae2d0ae-fd50-438e-a007-d63b77fb8f99 tempest-ProjectMemberTests-1907878748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:49 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0ae2d0ae-fd50-438e-a007-d63b77fb8f99 tempest-ProjectMemberTests-1907878748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0ae2d0ae-fd50-438e-a007-d63b77fb8f99 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0ae2d0ae-fd50-438e-a007-d63b77fb8f99 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-f3d149d5-b206-48a0-9a17-db71b695754f tempest-SnapshotDependencyTests-201229778 None] Lock "cinder-25ff9bfc-d206-4e12-a3ee-da6108ffe0b3-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:49 devstack sudo[108369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:52:49 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:49 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0ae2d0ae-fd50-438e-a007-d63b77fb8f99 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.268s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:49 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-0ae2d0ae-fd50-438e-a007-d63b77fb8f99 tempest-ProjectMemberTests-1907878748 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:49 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-0ae2d0ae-fd50-438e-a007-d63b77fb8f99 tempest-ProjectMemberTests-1907878748 None] Deleted volume successfully.
Nov 07 02:52:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-0ae2d0ae-fd50-438e-a007-d63b77fb8f99 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-afc907a6-3c07-47ee-b571-5c9a7d71e3ed-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cbab0b17-7d52-46c8-bebe-800d069023bc tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-5296712c-0ee7-49ce-86b1-0ad81458c711-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cbab0b17-7d52-46c8-bebe-800d069023bc tempest-ProjectReaderTests-1512630701 None] Lock "cinder-5296712c-0ee7-49ce-86b1-0ad81458c711-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cbab0b17-7d52-46c8-bebe-800d069023bc tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-quobyte-532943c5-884d-408c-a750-21f35594185a" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cbab0b17-7d52-46c8-bebe-800d069023bc tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-532943c5-884d-408c-a750-21f35594185a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cbab0b17-7d52-46c8-bebe-800d069023bc tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-quobyte-5296712c-0ee7-49ce-86b1-0ad81458c711" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cbab0b17-7d52-46c8-bebe-800d069023bc tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-5296712c-0ee7-49ce-86b1-0ad81458c711" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:49 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-cbab0b17-7d52-46c8-bebe-800d069023bc tempest-ProjectReaderTests-1512630701 None] Deleting offline snapshot 5296712c-0ee7-49ce-86b1-0ad81458c711 of volume 532943c5-884d-408c-a750-21f35594185a {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:52:49 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-cbab0b17-7d52-46c8-bebe-800d069023bc tempest-ProjectReaderTests-1512630701 None] snapshot_file for this snap is: volume-532943c5-884d-408c-a750-21f35594185a.5296712c-0ee7-49ce-86b1-0ad81458c711 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[afac21df-bee7-41fc-94bf-b920ffd83138]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cbab0b17-7d52-46c8-bebe-800d069023bc tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.5296712c-0ee7-49ce-86b1-0ad81458c711 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Flow 'volume_create_manager' (2399ef8a-8997-4038-aab5-8ac48476fd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfb0f34-cdbd-4084-b77f-4bf39f024fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfb0f34-cdbd-4084-b77f-4bf39f024fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-171662168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1bf45e-a52e-433d-b45a-3e05a75b7699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90854e8da8b14aa28568e8beba706c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:50Z,use_quota=True,user_id='813ad50b030d4d3fac7f68412673b863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345b0f2f-a4c3-4d13-bd58-fc758b18ad1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345b0f2f-a4c3-4d13-bd58-fc758b18ad1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3468c85-52e3-44b8-8996-ad3a7225d5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3468c85-52e3-44b8-8996-ad3a7225d5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae1bf45e-a52e-433d-b45a-3e05a75b7699', 'volume_name': 'volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab82a249-50c8-456f-9bc0-44b0a226423a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab82a249-50c8-456f-9bc0-44b0a226423a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:50 devstack sudo[108372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.5296712c-0ee7-49ce-86b1-0ad81458c711
Nov 07 02:52:50 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4da85a-6823-4086-b321-8226ade7c1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:50 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Volume ae1bf45e-a52e-433d-b45a-3e05a75b7699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699', 'volume_size': 1}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-171662168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1bf45e-a52e-433d-b45a-3e05a75b7699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90854e8da8b14aa28568e8beba706c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:50Z,use_quota=True,user_id='813ad50b030d4d3fac7f68412673b863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Creating volume ae1bf45e-a52e-433d-b45a-3e05a75b7699 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:50 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:50 devstack sudo[108374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699 1073741824
Nov 07 02:52:50 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:50 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cbab0b17-7d52-46c8-bebe-800d069023bc tempest-ProjectReaderTests-1512630701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.5296712c-0ee7-49ce-86b1-0ad81458c711" returned: 0 in 0.399s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-cbab0b17-7d52-46c8-bebe-800d069023bc tempest-ProjectReaderTests-1512630701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532943c5-884d-408c-a750-21f35594185a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64a057e-b670-44dd-8e39-4ed75acef8fe]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cbab0b17-7d52-46c8-bebe-800d069023bc tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:50 devstack sudo[108382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a
Nov 07 02:52:50 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:50 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699 1073741824" returned: 0 in 0.494s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:50 devstack sudo[108386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699
Nov 07 02:52:50 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:50 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cbab0b17-7d52-46c8-bebe-800d069023bc tempest-ProjectReaderTests-1512630701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a" returned: 0 in 0.434s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cbab0b17-7d52-46c8-bebe-800d069023bc tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.5296712c-0ee7-49ce-86b1-0ad81458c711 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:50 devstack sudo[108391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.5296712c-0ee7-49ce-86b1-0ad81458c711
Nov 07 02:52:50 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:50 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699" returned: 0 in 0.291s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4da85a-6823-4086-b321-8226ade7c1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (589d5472-cc11-4247-9793-75f11d685a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:51 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Volume volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699 (ae1bf45e-a52e-433d-b45a-3e05a75b7699): created successfully
Nov 07 02:52:51 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (589d5472-cc11-4247-9793-75f11d685a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:51 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Flow 'volume_create_manager' (2399ef8a-8997-4038-aab5-8ac48476fd1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:51 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-979ee136-bbdd-4c52-b1e8-c6628db7af66 tempest-ProjectMemberTests-1907878748 None] Created volume successfully.
Nov 07 02:52:51 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cbab0b17-7d52-46c8-bebe-800d069023bc tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.5296712c-0ee7-49ce-86b1-0ad81458c711" returned: 0 in 0.351s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cbab0b17-7d52-46c8-bebe-800d069023bc tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.5296712c-0ee7-49ce-86b1-0ad81458c711 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:51 devstack sudo[108398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.5296712c-0ee7-49ce-86b1-0ad81458c711
Nov 07 02:52:51 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:51 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cbab0b17-7d52-46c8-bebe-800d069023bc tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a.5296712c-0ee7-49ce-86b1-0ad81458c711" returned: 0 in 0.258s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cbab0b17-7d52-46c8-bebe-800d069023bc tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-5296712c-0ee7-49ce-86b1-0ad81458c711" released by "_delete_snapshot" :: held 1.583s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cbab0b17-7d52-46c8-bebe-800d069023bc tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-532943c5-884d-408c-a750-21f35594185a" released by "delete_snapshot" :: held 1.610s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:51 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-cbab0b17-7d52-46c8-bebe-800d069023bc tempest-ProjectReaderTests-1512630701 None] Created reservations ['bab0a66f-f148-4ecd-8b6f-45a4ea2cd126', '2a8fca54-f429-4cb6-b86d-a18ce5b32d55', '8a3735b3-704e-4c24-93cd-89e149b446e1', '0a117ea4-863c-424f-b121-7423d2954e75'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:51 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-cbab0b17-7d52-46c8-bebe-800d069023bc tempest-ProjectReaderTests-1512630701 None] Delete snapshot completed successfully.
Nov 07 02:52:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cbab0b17-7d52-46c8-bebe-800d069023bc tempest-ProjectReaderTests-1512630701 None] Lock "cinder-5296712c-0ee7-49ce-86b1-0ad81458c711-delete_snapshot" released by "delete_snapshot" :: held 1.755s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a30277bd-b0d4-4b6e-8890-3415c55be692 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-532943c5-884d-408c-a750-21f35594185a-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a30277bd-b0d4-4b6e-8890-3415c55be692 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-532943c5-884d-408c-a750-21f35594185a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a30277bd-b0d4-4b6e-8890-3415c55be692 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-quobyte-532943c5-884d-408c-a750-21f35594185a" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a30277bd-b0d4-4b6e-8890-3415c55be692 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-532943c5-884d-408c-a750-21f35594185a" acquired by "delete_volume" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:52 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[940975a4-7cf4-47a4-afee-11e53aee73ba]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a30277bd-b0d4-4b6e-8890-3415c55be692 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-fa68179d-4c38-4e07-8a10-73769c57ec62 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-fa68179d-4c38-4e07-8a10-73769c57ec62 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-fa68179d-4c38-4e07-8a10-73769c57ec62 tempest-ProjectMemberTests-1907878748 None] Creating offline snapshot 542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470 of volume ae1bf45e-a52e-433d-b45a-3e05a75b7699 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:52:52 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d69b878-516b-4f12-996a-15299994e5da]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fa68179d-4c38-4e07-8a10-73769c57ec62 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:52 devstack sudo[108401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a
Nov 07 02:52:52 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:52 devstack sudo[108402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699
Nov 07 02:52:52 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:52 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a30277bd-b0d4-4b6e-8890-3415c55be692 tempest-ProjectReaderTests-1512630701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a" returned: 0 in 0.419s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a30277bd-b0d4-4b6e-8890-3415c55be692 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:52 devstack sudo[108412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a
Nov 07 02:52:52 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:52 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fa68179d-4c38-4e07-8a10-73769c57ec62 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699" returned: 0 in 0.417s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fa68179d-4c38-4e07-8a10-73769c57ec62 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:52 devstack sudo[108414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470 1G
Nov 07 02:52:52 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:52 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a30277bd-b0d4-4b6e-8890-3415c55be692 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-532943c5-884d-408c-a750-21f35594185a" returned: 0 in 0.324s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a30277bd-b0d4-4b6e-8890-3415c55be692 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-532943c5-884d-408c-a750-21f35594185a" released by "delete_volume" :: held 0.837s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:52 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-a30277bd-b0d4-4b6e-8890-3415c55be692 tempest-ProjectReaderTests-1512630701 None] Created reservations ['4b574b50-255f-4e25-9ef0-7829dc7ad537', '629b0584-2ec8-4c59-8b7d-16a0a303bac1', '92b45660-65b5-4c34-aa59-d781fffdfe28', '173387f2-718a-4b4e-b800-f2296138378d'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a30277bd-b0d4-4b6e-8890-3415c55be692 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a30277bd-b0d4-4b6e-8890-3415c55be692 tempest-ProjectReaderTests-1512630701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a30277bd-b0d4-4b6e-8890-3415c55be692 tempest-ProjectReaderTests-1512630701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a30277bd-b0d4-4b6e-8890-3415c55be692 tempest-ProjectReaderTests-1512630701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a30277bd-b0d4-4b6e-8890-3415c55be692 tempest-ProjectReaderTests-1512630701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a30277bd-b0d4-4b6e-8890-3415c55be692 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:53 devstack sudo[108421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:52:53 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:53 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fa68179d-4c38-4e07-8a10-73769c57ec62 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470 1G" returned: 0 in 0.581s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fa68179d-4c38-4e07-8a10-73769c57ec62 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:53 devstack sudo[108423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470
Nov 07 02:52:53 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:53 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a30277bd-b0d4-4b6e-8890-3415c55be692 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.346s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-a30277bd-b0d4-4b6e-8890-3415c55be692 tempest-ProjectReaderTests-1512630701 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:53 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-a30277bd-b0d4-4b6e-8890-3415c55be692 tempest-ProjectReaderTests-1512630701 None] Deleted volume successfully.
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a30277bd-b0d4-4b6e-8890-3415c55be692 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-532943c5-884d-408c-a750-21f35594185a-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:53 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fa68179d-4c38-4e07-8a10-73769c57ec62 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470" returned: 0 in 0.398s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:53 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-fa68179d-4c38-4e07-8a10-73769c57ec62 tempest-ProjectMemberTests-1907878748 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470 is being set with open permissions: ugo+rw
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fa68179d-4c38-4e07-8a10-73769c57ec62 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:53 devstack sudo[108429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470
Nov 07 02:52:53 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Flow 'volume_create_manager' (dfe1eba0-3daf-4932-a7b5-f84b6df1cc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc356d1-e811-4a0f-9e42-fc2a7871dfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc356d1-e811-4a0f-9e42-fc2a7871dfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1812204304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=588f7843-614b-4ed1-821d-c8a6c8a93eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561b2b8c4de24651a364c4cb9b1460c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:54Z,use_quota=True,user_id='b507b952edd14904acb6904428c12ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0361ba78-5220-4b79-9ec1-c048e3f1d83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0361ba78-5220-4b79-9ec1-c048e3f1d83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f5099e-eabd-42e4-80ba-1082c45cf824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f5099e-eabd-42e4-80ba-1082c45cf824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '588f7843-614b-4ed1-821d-c8a6c8a93eaf', 'volume_name': 'volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e64f3b5-6a2f-44e9-ae39-15f47e58d377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e64f3b5-6a2f-44e9-ae39-15f47e58d377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd72271e-e651-46a0-a3de-7f3a10f24ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:53 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Volume 588f7843-614b-4ed1-821d-c8a6c8a93eaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf', 'volume_size': 1}
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:53 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fa68179d-4c38-4e07-8a10-73769c57ec62 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470" returned: 0 in 0.314s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:53 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fa68179d-4c38-4e07-8a10-73769c57ec62 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:53 devstack sudo[108433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.info
Nov 07 02:52:53 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:54 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fa68179d-4c38-4e07-8a10-73769c57ec62 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.info" returned: 0 in 0.267s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:54 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-fa68179d-4c38-4e07-8a10-73769c57ec62 tempest-ProjectMemberTests-1907878748 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.info is being set with open permissions: ugo+rw
Nov 07 02:52:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fa68179d-4c38-4e07-8a10-73769c57ec62 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:54 devstack sudo[108436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.info
Nov 07 02:52:54 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:54 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-fa68179d-4c38-4e07-8a10-73769c57ec62 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.info" returned: 0 in 0.256s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-fa68179d-4c38-4e07-8a10-73769c57ec62 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.324s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.586s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1812204304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=588f7843-614b-4ed1-821d-c8a6c8a93eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561b2b8c4de24651a364c4cb9b1460c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:52:54Z,use_quota=True,user_id='b507b952edd14904acb6904428c12ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Creating volume 588f7843-614b-4ed1-821d-c8a6c8a93eaf {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:54 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:54 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:52:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:54 devstack sudo[108439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf 1073741824
Nov 07 02:52:54 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:54 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-fa68179d-4c38-4e07-8a10-73769c57ec62 tempest-ProjectMemberTests-1907878748 None] Create snapshot completed successfully
Nov 07 02:52:54 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf 1073741824" returned: 0 in 0.431s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:54 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:55 devstack sudo[108444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf
Nov 07 02:52:55 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:55 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf" returned: 0 in 0.249s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:52:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd72271e-e651-46a0-a3de-7f3a10f24ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12554fae-ae03-4c66-9c05-bc55b6501391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:55 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Volume volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf (588f7843-614b-4ed1-821d-c8a6c8a93eaf): created successfully
Nov 07 02:52:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12554fae-ae03-4c66-9c05-bc55b6501391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:55 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Flow 'volume_create_manager' (dfe1eba0-3daf-4932-a7b5-f84b6df1cc5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:55 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-23785bc3-97cd-46b3-9cd2-1994677ee49c tempest-ProjectReaderTests-1512630701 None] Created volume successfully.
Nov 07 02:52:55 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2c2c29e0-737b-42f3-a3ae-986396a78b59 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:55 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2c2c29e0-737b-42f3-a3ae-986396a78b59 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:55 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2c2c29e0-737b-42f3-a3ae-986396a78b59 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-ae1bf45e-a52e-433d-b45a-3e05a75b7699" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:55 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2c2c29e0-737b-42f3-a3ae-986396a78b59 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-ae1bf45e-a52e-433d-b45a-3e05a75b7699" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:55 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2c2c29e0-737b-42f3-a3ae-986396a78b59 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:55 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2c2c29e0-737b-42f3-a3ae-986396a78b59 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-2c2c29e0-737b-42f3-a3ae-986396a78b59 tempest-ProjectMemberTests-1907878748 None] Deleting offline snapshot 542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470 of volume ae1bf45e-a52e-433d-b45a-3e05a75b7699 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:52:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-2c2c29e0-737b-42f3-a3ae-986396a78b59 tempest-ProjectMemberTests-1907878748 None] snapshot_file for this snap is: volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:52:55 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f24b870-be18-4bda-9686-0418aa9159db]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2c2c29e0-737b-42f3-a3ae-986396a78b59 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:55 devstack sudo[108447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470
Nov 07 02:52:55 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:55 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2c2c29e0-737b-42f3-a3ae-986396a78b59 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470" returned: 0 in 0.382s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:55 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-2c2c29e0-737b-42f3-a3ae-986396a78b59 tempest-ProjectMemberTests-1907878748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:52:55 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfbcb0f-3c6d-4982-9977-d8dfe01962ea]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:55 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2c2c29e0-737b-42f3-a3ae-986396a78b59 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3f0c1af1-3212-48c2-afaf-b0c42b7cbe3e tempest-ProjectReaderTests-1512630701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3f0c1af1-3212-48c2-afaf-b0c42b7cbe3e tempest-ProjectReaderTests-1512630701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:56 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-3f0c1af1-3212-48c2-afaf-b0c42b7cbe3e tempest-ProjectReaderTests-1512630701 None] Creating offline snapshot d53700af-1337-4b04-964c-f54f9df4a2da of volume 588f7843-614b-4ed1-821d-c8a6c8a93eaf {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:52:56 devstack sudo[108453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699
Nov 07 02:52:56 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:56 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e45d4f-2edc-42c3-9693-ae44f47d1200]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3f0c1af1-3212-48c2-afaf-b0c42b7cbe3e tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:56 devstack sudo[108456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf
Nov 07 02:52:56 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:56 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2c2c29e0-737b-42f3-a3ae-986396a78b59 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699" returned: 0 in 0.435s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2c2c29e0-737b-42f3-a3ae-986396a78b59 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:56 devstack sudo[108462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470
Nov 07 02:52:56 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:56 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3f0c1af1-3212-48c2-afaf-b0c42b7cbe3e tempest-ProjectReaderTests-1512630701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf" returned: 0 in 0.425s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3f0c1af1-3212-48c2-afaf-b0c42b7cbe3e tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.d53700af-1337-4b04-964c-f54f9df4a2da 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:56 devstack sudo[108467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.d53700af-1337-4b04-964c-f54f9df4a2da 1G
Nov 07 02:52:56 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:56 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2c2c29e0-737b-42f3-a3ae-986396a78b59 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470" returned: 0 in 0.399s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2c2c29e0-737b-42f3-a3ae-986396a78b59 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:56 devstack sudo[108475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470
Nov 07 02:52:56 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:56 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:56 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3f0c1af1-3212-48c2-afaf-b0c42b7cbe3e tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.d53700af-1337-4b04-964c-f54f9df4a2da 1G" returned: 0 in 0.464s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3f0c1af1-3212-48c2-afaf-b0c42b7cbe3e tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.d53700af-1337-4b04-964c-f54f9df4a2da {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:57 devstack sudo[108479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.d53700af-1337-4b04-964c-f54f9df4a2da
Nov 07 02:52:57 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:57 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-2c2c29e0-737b-42f3-a3ae-986396a78b59 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699.542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470" returned: 0 in 0.298s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:57 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2c2c29e0-737b-42f3-a3ae-986396a78b59 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470" released by "_delete_snapshot" :: held 1.651s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:57 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2c2c29e0-737b-42f3-a3ae-986396a78b59 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-ae1bf45e-a52e-433d-b45a-3e05a75b7699" released by "delete_snapshot" :: held 1.676s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:57 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-2c2c29e0-737b-42f3-a3ae-986396a78b59 tempest-ProjectMemberTests-1907878748 None] Created reservations ['e73167d0-c449-463c-8a73-93d0a11de1dc', 'd7758b12-2ccc-4b8d-a4c3-73fb9edadedd', '5fa7a0f4-9639-4c7c-ac90-80eb350c12fb', '570bb937-873e-4e01-93c9-677809ee73af'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:57 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-2c2c29e0-737b-42f3-a3ae-986396a78b59 tempest-ProjectMemberTests-1907878748 None] Delete snapshot completed successfully.
Nov 07 02:52:57 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-2c2c29e0-737b-42f3-a3ae-986396a78b59 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-542cd0cc-d3dd-4e8a-8caf-cc0bc2b8a470-delete_snapshot" released by "delete_snapshot" :: held 1.859s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:57 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3f0c1af1-3212-48c2-afaf-b0c42b7cbe3e tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.d53700af-1337-4b04-964c-f54f9df4a2da" returned: 0 in 0.361s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:57 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-3f0c1af1-3212-48c2-afaf-b0c42b7cbe3e tempest-ProjectReaderTests-1512630701 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.d53700af-1337-4b04-964c-f54f9df4a2da is being set with open permissions: ugo+rw
Nov 07 02:52:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3f0c1af1-3212-48c2-afaf-b0c42b7cbe3e tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.d53700af-1337-4b04-964c-f54f9df4a2da {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:57 devstack sudo[108485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.d53700af-1337-4b04-964c-f54f9df4a2da
Nov 07 02:52:57 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:57 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-703934f7-19ee-4424-8867-324da42637c2 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-ae1bf45e-a52e-433d-b45a-3e05a75b7699-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:57 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-703934f7-19ee-4424-8867-324da42637c2 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-ae1bf45e-a52e-433d-b45a-3e05a75b7699-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:57 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-703934f7-19ee-4424-8867-324da42637c2 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-ae1bf45e-a52e-433d-b45a-3e05a75b7699" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:57 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3f0c1af1-3212-48c2-afaf-b0c42b7cbe3e tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.d53700af-1337-4b04-964c-f54f9df4a2da" returned: 0 in 0.274s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:57 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-703934f7-19ee-4424-8867-324da42637c2 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-ae1bf45e-a52e-433d-b45a-3e05a75b7699" acquired by "delete_volume" :: waited 0.019s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:57 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23047f4-cfc5-4765-88e4-3c079c2f655d]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-703934f7-19ee-4424-8867-324da42637c2 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:57 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3f0c1af1-3212-48c2-afaf-b0c42b7cbe3e tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:57 devstack sudo[108490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.info
Nov 07 02:52:57 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:57 devstack sudo[108489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699
Nov 07 02:52:57 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:58 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3f0c1af1-3212-48c2-afaf-b0c42b7cbe3e tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.info" returned: 0 in 0.305s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:58 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-3f0c1af1-3212-48c2-afaf-b0c42b7cbe3e tempest-ProjectReaderTests-1512630701 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.info is being set with open permissions: ugo+rw
Nov 07 02:52:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3f0c1af1-3212-48c2-afaf-b0c42b7cbe3e tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:58 devstack sudo[108494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.info
Nov 07 02:52:58 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:58 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-703934f7-19ee-4424-8867-324da42637c2 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699" returned: 0 in 0.450s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-703934f7-19ee-4424-8867-324da42637c2 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:58 devstack sudo[108500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699
Nov 07 02:52:58 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:58 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3f0c1af1-3212-48c2-afaf-b0c42b7cbe3e tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.info" returned: 0 in 0.253s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3f0c1af1-3212-48c2-afaf-b0c42b7cbe3e tempest-ProjectReaderTests-1512630701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.250s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:58 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-3f0c1af1-3212-48c2-afaf-b0c42b7cbe3e tempest-ProjectReaderTests-1512630701 None] Create snapshot completed successfully
Nov 07 02:52:58 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-703934f7-19ee-4424-8867-324da42637c2 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ae1bf45e-a52e-433d-b45a-3e05a75b7699" returned: 0 in 0.264s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:58 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-703934f7-19ee-4424-8867-324da42637c2 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-ae1bf45e-a52e-433d-b45a-3e05a75b7699" released by "delete_volume" :: held 0.795s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:58 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=158,cinder:UPDATE=190,cinder:INSERT=50,cinder:DELETE=19 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:52:58 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-703934f7-19ee-4424-8867-324da42637c2 tempest-ProjectMemberTests-1907878748 None] Created reservations ['4e6f22e0-a88b-4c21-9fa0-186ec7a768ee', 'f4d1dad0-24e1-4e1f-af4e-3090e0a32199', '28fdb468-4d83-428d-8b45-3c30724f6f28', '35c8bc22-66cb-4f8d-9630-c568d4acb39d'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:52:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-703934f7-19ee-4424-8867-324da42637c2 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-703934f7-19ee-4424-8867-324da42637c2 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:58 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-703934f7-19ee-4424-8867-324da42637c2 tempest-ProjectMemberTests-1907878748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:58 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-703934f7-19ee-4424-8867-324da42637c2 tempest-ProjectMemberTests-1907878748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-703934f7-19ee-4424-8867-324da42637c2 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-703934f7-19ee-4424-8867-324da42637c2 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:58 devstack sudo[108505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:52:58 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:58 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:58 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-703934f7-19ee-4424-8867-324da42637c2 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.242s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:58 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-703934f7-19ee-4424-8867-324da42637c2 tempest-ProjectMemberTests-1907878748 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:58 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-703934f7-19ee-4424-8867-324da42637c2 tempest-ProjectMemberTests-1907878748 None] Deleted volume successfully.
Nov 07 02:52:58 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-703934f7-19ee-4424-8867-324da42637c2 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-ae1bf45e-a52e-433d-b45a-3e05a75b7699-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:59 devstack sudo[108508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:52:59 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cc56c032-012b-4e04-a29b-3b8ee69621ea tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-d53700af-1337-4b04-964c-f54f9df4a2da-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cc56c032-012b-4e04-a29b-3b8ee69621ea tempest-ProjectReaderTests-1512630701 None] Lock "cinder-d53700af-1337-4b04-964c-f54f9df4a2da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cc56c032-012b-4e04-a29b-3b8ee69621ea tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-quobyte-588f7843-614b-4ed1-821d-c8a6c8a93eaf" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cc56c032-012b-4e04-a29b-3b8ee69621ea tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-588f7843-614b-4ed1-821d-c8a6c8a93eaf" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cc56c032-012b-4e04-a29b-3b8ee69621ea tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-quobyte-d53700af-1337-4b04-964c-f54f9df4a2da" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cc56c032-012b-4e04-a29b-3b8ee69621ea tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-d53700af-1337-4b04-964c-f54f9df4a2da" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-cc56c032-012b-4e04-a29b-3b8ee69621ea tempest-ProjectReaderTests-1512630701 None] Deleting offline snapshot d53700af-1337-4b04-964c-f54f9df4a2da of volume 588f7843-614b-4ed1-821d-c8a6c8a93eaf {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-cc56c032-012b-4e04-a29b-3b8ee69621ea tempest-ProjectReaderTests-1512630701 None] snapshot_file for this snap is: volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.d53700af-1337-4b04-964c-f54f9df4a2da {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a89d0ed-073b-46e2-93cf-4b303edcc9bd]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cc56c032-012b-4e04-a29b-3b8ee69621ea tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.d53700af-1337-4b04-964c-f54f9df4a2da {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:59 devstack sudo[108510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.d53700af-1337-4b04-964c-f54f9df4a2da
Nov 07 02:52:59 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:59 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.384s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 28 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>, <Thread(fd_logger, started daemon 125443282798592)>, <Thread(privsep_reader, started daemon 125443284556288)>, <Thread(tpool_thread_0, started daemon 125443276445376)>, <Thread(tpool_thread_1, started daemon 125443268036288)>, <Thread(tpool_thread_2, started daemon 125443259627200)>, <Thread(tpool_thread_3, started daemon 125443251218112)>, <Thread(tpool_thread_4, started daemon 125443242809024)>, <Thread(tpool_thread_5, started daemon 125443234399936)>, <Thread(tpool_thread_6, started daemon 125443225990848)>, <Thread(tpool_thread_7, started daemon 125443217581760)>, <Thread(tpool_thread_8, started daemon 125443209172672)>, <Thread(tpool_thread_9, started daemon 125443200763584)>, <Thread(tpool_thread_10, started daemon 125443192354496)>, <Thread(tpool_thread_11, started daemon 125443183945408)>, <Thread(tpool_thread_12, started daemon 125443175536320)>, <Thread(tpool_thread_13, started daemon 125443167127232)>, <Thread(tpool_thread_14, started daemon 125443158718144)>, <Thread(tpool_thread_15, started daemon 125443150309056)>, <Thread(tpool_thread_16, started daemon 125443141899968)>, <Thread(tpool_thread_17, started daemon 125443133490880)>, <Thread(tpool_thread_18, started daemon 125443125081792)>, <Thread(tpool_thread_19, started daemon 125443116672704)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Flow 'volume_create_manager' (9f1cf17a-0c64-48fb-9530-11b64a60e12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (227f0335-6a80-4fcc-a361-24f5f72f450f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (227f0335-6a80-4fcc-a361-24f5f72f450f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-833561578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4b8492-0379-48ae-8dfd-8564bd1a9659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90854e8da8b14aa28568e8beba706c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:00Z,use_quota=True,user_id='813ad50b030d4d3fac7f68412673b863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee8bd7e2-5927-4db4-991f-012b360965ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee8bd7e2-5927-4db4-991f-012b360965ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4efcc875-4b5c-4b42-a910-ba9336e3d4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4efcc875-4b5c-4b42-a910-ba9336e3d4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b4b8492-0379-48ae-8dfd-8564bd1a9659', 'volume_name': 'volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c8a4b0a-30a0-43fc-b022-1ea118a3d27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c8a4b0a-30a0-43fc-b022-1ea118a3d27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (173d2611-ca66-454f-b7d0-33a4aab79619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:52:59 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Volume 1b4b8492-0379-48ae-8dfd-8564bd1a9659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659', 'volume_size': 1}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-833561578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4b8492-0379-48ae-8dfd-8564bd1a9659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90854e8da8b14aa28568e8beba706c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:00Z,use_quota=True,user_id='813ad50b030d4d3fac7f68412673b863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Creating volume 1b4b8492-0379-48ae-8dfd-8564bd1a9659 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:52:59 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:52:59 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root
Nov 07 02:52:59 devstack sudo[108516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659 1073741824
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cc56c032-012b-4e04-a29b-3b8ee69621ea tempest-ProjectReaderTests-1512630701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.d53700af-1337-4b04-964c-f54f9df4a2da" returned: 0 in 0.483s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-cc56c032-012b-4e04-a29b-3b8ee69621ea tempest-ProjectReaderTests-1512630701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:52:59 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[754b654e-ea1c-44e6-af4b-5b9327e10111]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:52:59 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cc56c032-012b-4e04-a29b-3b8ee69621ea tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:00 devstack sudo[108519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf
Nov 07 02:53:00 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:00 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cc56c032-012b-4e04-a29b-3b8ee69621ea tempest-ProjectReaderTests-1512630701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf" returned: 0 in 0.455s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cc56c032-012b-4e04-a29b-3b8ee69621ea tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.d53700af-1337-4b04-964c-f54f9df4a2da {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:00 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659 1073741824" returned: 0 in 0.563s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:00 devstack sudo[108527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.d53700af-1337-4b04-964c-f54f9df4a2da
Nov 07 02:53:00 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:00 devstack sudo[108529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659
Nov 07 02:53:00 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:00 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659" returned: 0 in 0.307s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:00 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:53:00 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cc56c032-012b-4e04-a29b-3b8ee69621ea tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.d53700af-1337-4b04-964c-f54f9df4a2da" returned: 0 in 0.405s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:00 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cc56c032-012b-4e04-a29b-3b8ee69621ea tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.d53700af-1337-4b04-964c-f54f9df4a2da {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (173d2611-ca66-454f-b7d0-33a4aab79619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05f9e69a-79d8-405e-b8b4-5f6b7b233e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:00 devstack sudo[108536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.d53700af-1337-4b04-964c-f54f9df4a2da
Nov 07 02:53:00 devstack sudo[108536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:00 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Volume volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659 (1b4b8492-0379-48ae-8dfd-8564bd1a9659): created successfully
Nov 07 02:53:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05f9e69a-79d8-405e-b8b4-5f6b7b233e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:00 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Flow 'volume_create_manager' (9f1cf17a-0c64-48fb-9530-11b64a60e12b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:00 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c36ce467-5b73-4134-b992-b2f893dc21c7 tempest-ProjectMemberTests-1907878748 None] Created volume successfully.
Nov 07 02:53:01 devstack sudo[108536]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-cc56c032-012b-4e04-a29b-3b8ee69621ea tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf.d53700af-1337-4b04-964c-f54f9df4a2da" returned: 0 in 0.277s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cc56c032-012b-4e04-a29b-3b8ee69621ea tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-d53700af-1337-4b04-964c-f54f9df4a2da" released by "_delete_snapshot" :: held 1.756s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cc56c032-012b-4e04-a29b-3b8ee69621ea tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-588f7843-614b-4ed1-821d-c8a6c8a93eaf" released by "delete_snapshot" :: held 1.791s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:01 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-cc56c032-012b-4e04-a29b-3b8ee69621ea tempest-ProjectReaderTests-1512630701 None] Created reservations ['29913bdf-41e8-48d1-acf2-9dc3c17f6078', '32d62a66-2234-45fc-bbd2-800f8797e74a', '28e711e6-535f-4c9d-9d72-2af775dedcc6', 'a7d3e173-5baf-408e-b201-ce5339fafe0a'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:01 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-cc56c032-012b-4e04-a29b-3b8ee69621ea tempest-ProjectReaderTests-1512630701 None] Delete snapshot completed successfully.
Nov 07 02:53:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-cc56c032-012b-4e04-a29b-3b8ee69621ea tempest-ProjectReaderTests-1512630701 None] Lock "cinder-d53700af-1337-4b04-964c-f54f9df4a2da-delete_snapshot" released by "delete_snapshot" :: held 1.961s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e817c948-095c-4af0-b10f-9301408df45d tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-588f7843-614b-4ed1-821d-c8a6c8a93eaf-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e817c948-095c-4af0-b10f-9301408df45d tempest-ProjectReaderTests-1512630701 None] Lock "cinder-588f7843-614b-4ed1-821d-c8a6c8a93eaf-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e817c948-095c-4af0-b10f-9301408df45d tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-quobyte-588f7843-614b-4ed1-821d-c8a6c8a93eaf" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:01 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e817c948-095c-4af0-b10f-9301408df45d tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-588f7843-614b-4ed1-821d-c8a6c8a93eaf" acquired by "delete_volume" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:01 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1d621d-5447-4827-b340-b92964986c84]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:01 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e817c948-095c-4af0-b10f-9301408df45d tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:01 devstack sudo[108539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf
Nov 07 02:53:01 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:02 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e817c948-095c-4af0-b10f-9301408df45d tempest-ProjectReaderTests-1512630701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf" returned: 0 in 0.459s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e817c948-095c-4af0-b10f-9301408df45d tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ed618b68-b4bc-404f-a4ba-69744642dd23 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ed618b68-b4bc-404f-a4ba-69744642dd23 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:02 devstack sudo[108544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf
Nov 07 02:53:02 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:02 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-ed618b68-b4bc-404f-a4ba-69744642dd23 tempest-ProjectMemberTests-1907878748 None] Creating offline snapshot b9a068c3-0ff8-4be8-be44-b3399760dd85 of volume 1b4b8492-0379-48ae-8dfd-8564bd1a9659 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:53:02 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[df366b8b-9328-4116-ac90-c25099eca56b]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ed618b68-b4bc-404f-a4ba-69744642dd23 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:02 devstack sudo[108546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659
Nov 07 02:53:02 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:02 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e817c948-095c-4af0-b10f-9301408df45d tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-588f7843-614b-4ed1-821d-c8a6c8a93eaf" returned: 0 in 0.301s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e817c948-095c-4af0-b10f-9301408df45d tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-588f7843-614b-4ed1-821d-c8a6c8a93eaf" released by "delete_volume" :: held 0.823s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:02 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-e817c948-095c-4af0-b10f-9301408df45d tempest-ProjectReaderTests-1512630701 None] Created reservations ['829806be-a3ad-4ac3-91a7-62ced2f0589a', '3ebd7bee-a684-44df-a3a1-46b18120b630', '1a56aaea-cfdb-441c-a0c8-c60857faf214', 'b50795ad-ff09-48ef-bb4e-26d92b36c7ed'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e817c948-095c-4af0-b10f-9301408df45d tempest-ProjectReaderTests-1512630701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e817c948-095c-4af0-b10f-9301408df45d tempest-ProjectReaderTests-1512630701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:02 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e817c948-095c-4af0-b10f-9301408df45d tempest-ProjectReaderTests-1512630701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:02 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-e817c948-095c-4af0-b10f-9301408df45d tempest-ProjectReaderTests-1512630701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-e817c948-095c-4af0-b10f-9301408df45d tempest-ProjectReaderTests-1512630701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e817c948-095c-4af0-b10f-9301408df45d tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:02 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:02 devstack sudo[108552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:53:02 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ed618b68-b4bc-404f-a4ba-69744642dd23 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659" returned: 0 in 0.410s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ed618b68-b4bc-404f-a4ba-69744642dd23 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.b9a068c3-0ff8-4be8-be44-b3399760dd85 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:02 devstack sudo[108554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.b9a068c3-0ff8-4be8-be44-b3399760dd85 1G
Nov 07 02:53:02 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:02 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-e817c948-095c-4af0-b10f-9301408df45d tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.251s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:02 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-e817c948-095c-4af0-b10f-9301408df45d tempest-ProjectReaderTests-1512630701 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:02 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-e817c948-095c-4af0-b10f-9301408df45d tempest-ProjectReaderTests-1512630701 None] Deleted volume successfully.
Nov 07 02:53:02 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-e817c948-095c-4af0-b10f-9301408df45d tempest-ProjectReaderTests-1512630701 None] Lock "cinder-588f7843-614b-4ed1-821d-c8a6c8a93eaf-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:02 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ed618b68-b4bc-404f-a4ba-69744642dd23 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.b9a068c3-0ff8-4be8-be44-b3399760dd85 1G" returned: 0 in 0.474s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:02 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ed618b68-b4bc-404f-a4ba-69744642dd23 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.b9a068c3-0ff8-4be8-be44-b3399760dd85 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:02 devstack sudo[108561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.b9a068c3-0ff8-4be8-be44-b3399760dd85
Nov 07 02:53:02 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:03 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:53:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Flow 'volume_create_manager' (adfb9b6a-2475-4589-80b6-1b15962f5e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41751d4d-5a8f-4262-a1e7-53ca463ae538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41751d4d-5a8f-4262-a1e7-53ca463ae538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-739623282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23a55bb1-199b-42ac-8477-c12e313d3e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561b2b8c4de24651a364c4cb9b1460c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:03Z,use_quota=True,user_id='b507b952edd14904acb6904428c12ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea112c18-9378-4c6f-a3ba-8466f61b3ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea112c18-9378-4c6f-a3ba-8466f61b3ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6bef3bd-2b71-47ab-837c-a0c71ab31635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6bef3bd-2b71-47ab-837c-a0c71ab31635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23a55bb1-199b-42ac-8477-c12e313d3e4f', 'volume_name': 'volume-23a55bb1-199b-42ac-8477-c12e313d3e4f', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287bda42-7605-4ada-94db-cabb8d69a79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287bda42-7605-4ada-94db-cabb8d69a79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:03 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f037917-923a-4c0a-aba3-d71bd2fa3885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:03 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Volume 23a55bb1-199b-42ac-8477-c12e313d3e4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23a55bb1-199b-42ac-8477-c12e313d3e4f', 'volume_size': 1}
Nov 07 02:53:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:03 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ed618b68-b4bc-404f-a4ba-69744642dd23 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.b9a068c3-0ff8-4be8-be44-b3399760dd85" returned: 0 in 0.299s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:03 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-ed618b68-b4bc-404f-a4ba-69744642dd23 tempest-ProjectMemberTests-1907878748 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.b9a068c3-0ff8-4be8-be44-b3399760dd85 is being set with open permissions: ugo+rw
Nov 07 02:53:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ed618b68-b4bc-404f-a4ba-69744642dd23 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.b9a068c3-0ff8-4be8-be44-b3399760dd85 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:03 devstack sudo[108566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.b9a068c3-0ff8-4be8-be44-b3399760dd85
Nov 07 02:53:03 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:03 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ed618b68-b4bc-404f-a4ba-69744642dd23 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.b9a068c3-0ff8-4be8-be44-b3399760dd85" returned: 0 in 0.243s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ed618b68-b4bc-404f-a4ba-69744642dd23 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:03 devstack sudo[108569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.info
Nov 07 02:53:03 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:03 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ed618b68-b4bc-404f-a4ba-69744642dd23 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.info" returned: 0 in 0.238s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:03 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-ed618b68-b4bc-404f-a4ba-69744642dd23 tempest-ProjectMemberTests-1907878748 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.info is being set with open permissions: ugo+rw
Nov 07 02:53:03 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ed618b68-b4bc-404f-a4ba-69744642dd23 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:03 devstack sudo[108572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.info
Nov 07 02:53:03 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:04 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ed618b68-b4bc-404f-a4ba-69744642dd23 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.info" returned: 0 in 0.240s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ed618b68-b4bc-404f-a4ba-69744642dd23 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.003s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.889s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-739623282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23a55bb1-199b-42ac-8477-c12e313d3e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561b2b8c4de24651a364c4cb9b1460c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:03Z,use_quota=True,user_id='b507b952edd14904acb6904428c12ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:53:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Creating volume 23a55bb1-199b-42ac-8477-c12e313d3e4f {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:53:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:53:04 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:53:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:04 devstack sudo[108575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f 1073741824
Nov 07 02:53:04 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:04 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ed618b68-b4bc-404f-a4ba-69744642dd23 tempest-ProjectMemberTests-1907878748 None] Create snapshot completed successfully
Nov 07 02:53:04 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f 1073741824" returned: 0 in 0.415s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:04 devstack sudo[108581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f
Nov 07 02:53:04 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:04 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f" returned: 0 in 0.246s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:04 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:53:04 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f037917-923a-4c0a-aba3-d71bd2fa3885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23a55bb1-199b-42ac-8477-c12e313d3e4f', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1e044d-a156-467f-9173-dee6cc06c7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:04 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Volume volume-23a55bb1-199b-42ac-8477-c12e313d3e4f (23a55bb1-199b-42ac-8477-c12e313d3e4f): created successfully
Nov 07 02:53:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1e044d-a156-467f-9173-dee6cc06c7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:04 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Flow 'volume_create_manager' (adfb9b6a-2475-4589-80b6-1b15962f5e56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:04 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-1ecf738b-7fbf-4819-940a-dc2283ed269d tempest-ProjectReaderTests-1512630701 None] Created volume successfully.
Nov 07 02:53:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-33c2ed53-9888-442d-a940-67096880eb50 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-b9a068c3-0ff8-4be8-be44-b3399760dd85-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-33c2ed53-9888-442d-a940-67096880eb50 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-b9a068c3-0ff8-4be8-be44-b3399760dd85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-33c2ed53-9888-442d-a940-67096880eb50 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-1b4b8492-0379-48ae-8dfd-8564bd1a9659" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-33c2ed53-9888-442d-a940-67096880eb50 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-1b4b8492-0379-48ae-8dfd-8564bd1a9659" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-33c2ed53-9888-442d-a940-67096880eb50 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-b9a068c3-0ff8-4be8-be44-b3399760dd85" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:05 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-33c2ed53-9888-442d-a940-67096880eb50 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-b9a068c3-0ff8-4be8-be44-b3399760dd85" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-33c2ed53-9888-442d-a940-67096880eb50 tempest-ProjectMemberTests-1907878748 None] Deleting offline snapshot b9a068c3-0ff8-4be8-be44-b3399760dd85 of volume 1b4b8492-0379-48ae-8dfd-8564bd1a9659 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:53:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-33c2ed53-9888-442d-a940-67096880eb50 tempest-ProjectMemberTests-1907878748 None] snapshot_file for this snap is: volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.b9a068c3-0ff8-4be8-be44-b3399760dd85 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:53:05 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[da308c0e-bd10-4881-8fcb-fc36c2713b29]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-33c2ed53-9888-442d-a940-67096880eb50 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.b9a068c3-0ff8-4be8-be44-b3399760dd85 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dd13e7f6-5bad-4aa2-99f7-a2be344145c1 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dd13e7f6-5bad-4aa2-99f7-a2be344145c1 tempest-ProjectReaderTests-1512630701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-dd13e7f6-5bad-4aa2-99f7-a2be344145c1 tempest-ProjectReaderTests-1512630701 None] Creating offline snapshot de59eaa6-fc0f-45f0-9082-a6cfaca4018a of volume 23a55bb1-199b-42ac-8477-c12e313d3e4f {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:53:05 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e718220-c683-4100-ab3d-faa18aca08c2]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dd13e7f6-5bad-4aa2-99f7-a2be344145c1 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:05 devstack sudo[108584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.b9a068c3-0ff8-4be8-be44-b3399760dd85
Nov 07 02:53:05 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:05 devstack sudo[108585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f
Nov 07 02:53:05 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:05 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-33c2ed53-9888-442d-a940-67096880eb50 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.b9a068c3-0ff8-4be8-be44-b3399760dd85" returned: 0 in 0.366s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:05 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-33c2ed53-9888-442d-a940-67096880eb50 tempest-ProjectMemberTests-1907878748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:53:05 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c8877a-1a96-4dcb-997d-928ce0015d13]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-33c2ed53-9888-442d-a940-67096880eb50 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:05 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dd13e7f6-5bad-4aa2-99f7-a2be344145c1 tempest-ProjectReaderTests-1512630701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f" returned: 0 in 0.374s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:05 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dd13e7f6-5bad-4aa2-99f7-a2be344145c1 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.de59eaa6-fc0f-45f0-9082-a6cfaca4018a 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:05 devstack sudo[108595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.de59eaa6-fc0f-45f0-9082-a6cfaca4018a 1G
Nov 07 02:53:05 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:05 devstack sudo[108594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659
Nov 07 02:53:05 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:06 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-33c2ed53-9888-442d-a940-67096880eb50 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659" returned: 0 in 0.371s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-33c2ed53-9888-442d-a940-67096880eb50 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.b9a068c3-0ff8-4be8-be44-b3399760dd85 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:06 devstack sudo[108604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.b9a068c3-0ff8-4be8-be44-b3399760dd85
Nov 07 02:53:06 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:06 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dd13e7f6-5bad-4aa2-99f7-a2be344145c1 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.de59eaa6-fc0f-45f0-9082-a6cfaca4018a 1G" returned: 0 in 0.422s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dd13e7f6-5bad-4aa2-99f7-a2be344145c1 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23a55bb1-199b-42ac-8477-c12e313d3e4f -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.de59eaa6-fc0f-45f0-9082-a6cfaca4018a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:06 devstack sudo[108607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23a55bb1-199b-42ac-8477-c12e313d3e4f -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.de59eaa6-fc0f-45f0-9082-a6cfaca4018a
Nov 07 02:53:06 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:06 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-33c2ed53-9888-442d-a940-67096880eb50 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.b9a068c3-0ff8-4be8-be44-b3399760dd85" returned: 0 in 0.348s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-33c2ed53-9888-442d-a940-67096880eb50 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.b9a068c3-0ff8-4be8-be44-b3399760dd85 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:06 devstack sudo[108615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.b9a068c3-0ff8-4be8-be44-b3399760dd85
Nov 07 02:53:06 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:06 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dd13e7f6-5bad-4aa2-99f7-a2be344145c1 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23a55bb1-199b-42ac-8477-c12e313d3e4f -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.de59eaa6-fc0f-45f0-9082-a6cfaca4018a" returned: 0 in 0.323s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:06 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-dd13e7f6-5bad-4aa2-99f7-a2be344145c1 tempest-ProjectReaderTests-1512630701 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.de59eaa6-fc0f-45f0-9082-a6cfaca4018a is being set with open permissions: ugo+rw
Nov 07 02:53:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dd13e7f6-5bad-4aa2-99f7-a2be344145c1 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.de59eaa6-fc0f-45f0-9082-a6cfaca4018a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:06 devstack sudo[108617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.de59eaa6-fc0f-45f0-9082-a6cfaca4018a
Nov 07 02:53:06 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:06 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-33c2ed53-9888-442d-a940-67096880eb50 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659.b9a068c3-0ff8-4be8-be44-b3399760dd85" returned: 0 in 0.254s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:06 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-33c2ed53-9888-442d-a940-67096880eb50 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-b9a068c3-0ff8-4be8-be44-b3399760dd85" released by "_delete_snapshot" :: held 1.469s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:06 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-33c2ed53-9888-442d-a940-67096880eb50 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-1b4b8492-0379-48ae-8dfd-8564bd1a9659" released by "delete_snapshot" :: held 1.497s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:06 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dd13e7f6-5bad-4aa2-99f7-a2be344145c1 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.de59eaa6-fc0f-45f0-9082-a6cfaca4018a" returned: 0 in 0.268s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:06 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dd13e7f6-5bad-4aa2-99f7-a2be344145c1 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:06 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-33c2ed53-9888-442d-a940-67096880eb50 tempest-ProjectMemberTests-1907878748 None] Created reservations ['a9c5b80c-c6af-4a9c-96c8-7a13da947f2d', 'fc954951-01c3-40b2-8194-78855dce8d61', '0733bff9-9fe9-485a-8b32-5e4b5b2352c2', 'e9e63a8b-43f0-4233-8612-f0762c2ea83d'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:06 devstack sudo[108655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.info
Nov 07 02:53:06 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:06 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-33c2ed53-9888-442d-a940-67096880eb50 tempest-ProjectMemberTests-1907878748 None] Delete snapshot completed successfully.
Nov 07 02:53:06 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-33c2ed53-9888-442d-a940-67096880eb50 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-b9a068c3-0ff8-4be8-be44-b3399760dd85-delete_snapshot" released by "delete_snapshot" :: held 1.690s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:07 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dd13e7f6-5bad-4aa2-99f7-a2be344145c1 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.info" returned: 0 in 0.264s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:07 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-dd13e7f6-5bad-4aa2-99f7-a2be344145c1 tempest-ProjectReaderTests-1512630701 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.info is being set with open permissions: ugo+rw
Nov 07 02:53:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dd13e7f6-5bad-4aa2-99f7-a2be344145c1 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:07 devstack sudo[108660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.info
Nov 07 02:53:07 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:07 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-dd13e7f6-5bad-4aa2-99f7-a2be344145c1 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.info" returned: 0 in 0.251s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-dd13e7f6-5bad-4aa2-99f7-a2be344145c1 tempest-ProjectReaderTests-1512630701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:07 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-dd13e7f6-5bad-4aa2-99f7-a2be344145c1 tempest-ProjectReaderTests-1512630701 None] Create snapshot completed successfully
Nov 07 02:53:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a219efc2-6de7-43d7-8236-9808a1ce7e92 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-1b4b8492-0379-48ae-8dfd-8564bd1a9659-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a219efc2-6de7-43d7-8236-9808a1ce7e92 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-1b4b8492-0379-48ae-8dfd-8564bd1a9659-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a219efc2-6de7-43d7-8236-9808a1ce7e92 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-1b4b8492-0379-48ae-8dfd-8564bd1a9659" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:07 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a219efc2-6de7-43d7-8236-9808a1ce7e92 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-1b4b8492-0379-48ae-8dfd-8564bd1a9659" acquired by "delete_volume" :: waited 0.014s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:07 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f467121-1b4a-424b-a115-d93b4dc7c9ff]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a219efc2-6de7-43d7-8236-9808a1ce7e92 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:07 devstack sudo[108663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659
Nov 07 02:53:07 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:07 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a219efc2-6de7-43d7-8236-9808a1ce7e92 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659" returned: 0 in 0.349s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:07 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a219efc2-6de7-43d7-8236-9808a1ce7e92 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:07 devstack sudo[108668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659
Nov 07 02:53:07 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:08 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a219efc2-6de7-43d7-8236-9808a1ce7e92 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-1b4b8492-0379-48ae-8dfd-8564bd1a9659" returned: 0 in 0.246s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a219efc2-6de7-43d7-8236-9808a1ce7e92 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-1b4b8492-0379-48ae-8dfd-8564bd1a9659" released by "delete_volume" :: held 0.656s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:08 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-a219efc2-6de7-43d7-8236-9808a1ce7e92 tempest-ProjectMemberTests-1907878748 None] Created reservations ['4f1e852a-0503-4d0d-ae44-14da716ce1eb', 'baffe629-dc16-4096-959c-de30e666a6e9', '444bf40c-d036-48f0-802b-03eee69fe5e3', 'e44ad9e1-adec-4292-a00c-ccc9cecb46c6'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a219efc2-6de7-43d7-8236-9808a1ce7e92 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a219efc2-6de7-43d7-8236-9808a1ce7e92 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a219efc2-6de7-43d7-8236-9808a1ce7e92 tempest-ProjectMemberTests-1907878748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a219efc2-6de7-43d7-8236-9808a1ce7e92 tempest-ProjectMemberTests-1907878748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a219efc2-6de7-43d7-8236-9808a1ce7e92 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a219efc2-6de7-43d7-8236-9808a1ce7e92 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:08 devstack sudo[108671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:53:08 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:08 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a219efc2-6de7-43d7-8236-9808a1ce7e92 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.252s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:08 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-a219efc2-6de7-43d7-8236-9808a1ce7e92 tempest-ProjectMemberTests-1907878748 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:08 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-a219efc2-6de7-43d7-8236-9808a1ce7e92 tempest-ProjectMemberTests-1907878748 None] Deleted volume successfully.
Nov 07 02:53:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a219efc2-6de7-43d7-8236-9808a1ce7e92 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-1b4b8492-0379-48ae-8dfd-8564bd1a9659-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c764b64f-cd6a-4ba7-a079-f87f1f44da02 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-de59eaa6-fc0f-45f0-9082-a6cfaca4018a-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c764b64f-cd6a-4ba7-a079-f87f1f44da02 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-de59eaa6-fc0f-45f0-9082-a6cfaca4018a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c764b64f-cd6a-4ba7-a079-f87f1f44da02 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-quobyte-23a55bb1-199b-42ac-8477-c12e313d3e4f" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c764b64f-cd6a-4ba7-a079-f87f1f44da02 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-23a55bb1-199b-42ac-8477-c12e313d3e4f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c764b64f-cd6a-4ba7-a079-f87f1f44da02 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-quobyte-de59eaa6-fc0f-45f0-9082-a6cfaca4018a" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:08 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c764b64f-cd6a-4ba7-a079-f87f1f44da02 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-de59eaa6-fc0f-45f0-9082-a6cfaca4018a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-c764b64f-cd6a-4ba7-a079-f87f1f44da02 tempest-ProjectReaderTests-1512630701 None] Deleting offline snapshot de59eaa6-fc0f-45f0-9082-a6cfaca4018a of volume 23a55bb1-199b-42ac-8477-c12e313d3e4f {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:53:08 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-c764b64f-cd6a-4ba7-a079-f87f1f44da02 tempest-ProjectReaderTests-1512630701 None] snapshot_file for this snap is: volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.de59eaa6-fc0f-45f0-9082-a6cfaca4018a {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:53:08 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c9d58f-6d36-4905-91f2-fbd78b3529b7]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:08 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c764b64f-cd6a-4ba7-a079-f87f1f44da02 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.de59eaa6-fc0f-45f0-9082-a6cfaca4018a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:08 devstack sudo[108675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.de59eaa6-fc0f-45f0-9082-a6cfaca4018a
Nov 07 02:53:08 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:53:09 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Flow 'volume_create_manager' (a2c2e602-b9d7-4566-a2c6-f64e627680bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0379b90-2672-44dd-a1c1-bd20b7b98700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c764b64f-cd6a-4ba7-a079-f87f1f44da02 tempest-ProjectReaderTests-1512630701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.de59eaa6-fc0f-45f0-9082-a6cfaca4018a" returned: 0 in 0.437s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-c764b64f-cd6a-4ba7-a079-f87f1f44da02 tempest-ProjectReaderTests-1512630701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23a55bb1-199b-42ac-8477-c12e313d3e4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0379b90-2672-44dd-a1c1-bd20b7b98700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-254270417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857b580c-4261-410a-a632-3c550595ed05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90854e8da8b14aa28568e8beba706c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:09Z,use_quota=True,user_id='813ad50b030d4d3fac7f68412673b863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21493cb0-7272-4cc4-8d69-e009b1a5d654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21493cb0-7272-4cc4-8d69-e009b1a5d654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d911c06a-ef31-4964-953d-84217e0232ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d911c06a-ef31-4964-953d-84217e0232ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '857b580c-4261-410a-a632-3c550595ed05', 'volume_name': 'volume-857b580c-4261-410a-a632-3c550595ed05', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8644d8d7-b38c-4f8d-8a74-1bff04e47321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8644d8d7-b38c-4f8d-8a74-1bff04e47321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b1d02d-10b4-4197-9759-84f5115add8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:09 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Volume 857b580c-4261-410a-a632-3c550595ed05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-857b580c-4261-410a-a632-3c550595ed05', 'volume_size': 1}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-254270417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857b580c-4261-410a-a632-3c550595ed05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90854e8da8b14aa28568e8beba706c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:09Z,use_quota=True,user_id='813ad50b030d4d3fac7f68412673b863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Creating volume 857b580c-4261-410a-a632-3c550595ed05 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:53:09 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[580fa312-51cc-405d-900c-f94745b654f9]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c764b64f-cd6a-4ba7-a079-f87f1f44da02 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:09 devstack sudo[108680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05 1073741824
Nov 07 02:53:09 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:09 devstack sudo[108681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f
Nov 07 02:53:09 devstack sudo[108681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:09 devstack sudo[108681]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c764b64f-cd6a-4ba7-a079-f87f1f44da02 tempest-ProjectReaderTests-1512630701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f" returned: 0 in 0.387s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c764b64f-cd6a-4ba7-a079-f87f1f44da02 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.de59eaa6-fc0f-45f0-9082-a6cfaca4018a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:09 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05 1073741824" returned: 0 in 0.432s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:09 devstack sudo[108691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.de59eaa6-fc0f-45f0-9082-a6cfaca4018a
Nov 07 02:53:09 devstack sudo[108691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:09 devstack sudo[108693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05
Nov 07 02:53:09 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:09 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05" returned: 0 in 0.255s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b1d02d-10b4-4197-9759-84f5115add8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-857b580c-4261-410a-a632-3c550595ed05', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dcbd4af-f618-42ee-bec6-720cd07ffac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:09 devstack sudo[108691]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c764b64f-cd6a-4ba7-a079-f87f1f44da02 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.de59eaa6-fc0f-45f0-9082-a6cfaca4018a" returned: 0 in 0.351s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c764b64f-cd6a-4ba7-a079-f87f1f44da02 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.de59eaa6-fc0f-45f0-9082-a6cfaca4018a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:09 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Volume volume-857b580c-4261-410a-a632-3c550595ed05 (857b580c-4261-410a-a632-3c550595ed05): created successfully
Nov 07 02:53:09 devstack sudo[108700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.de59eaa6-fc0f-45f0-9082-a6cfaca4018a
Nov 07 02:53:09 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dcbd4af-f618-42ee-bec6-720cd07ffac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:09 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Flow 'volume_create_manager' (a2c2e602-b9d7-4566-a2c6-f64e627680bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:09 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b8344f59-a735-4c6e-8a69-1801956e1991 tempest-ProjectMemberTests-1907878748 None] Created volume successfully.
Nov 07 02:53:10 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c764b64f-cd6a-4ba7-a079-f87f1f44da02 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f.de59eaa6-fc0f-45f0-9082-a6cfaca4018a" returned: 0 in 0.272s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:10 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c764b64f-cd6a-4ba7-a079-f87f1f44da02 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-de59eaa6-fc0f-45f0-9082-a6cfaca4018a" released by "_delete_snapshot" :: held 1.616s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:10 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c764b64f-cd6a-4ba7-a079-f87f1f44da02 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-23a55bb1-199b-42ac-8477-c12e313d3e4f" released by "delete_snapshot" :: held 1.640s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:10 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-c764b64f-cd6a-4ba7-a079-f87f1f44da02 tempest-ProjectReaderTests-1512630701 None] Created reservations ['e473295f-40b3-46fc-81a8-667a6a971b3c', '9bdfc8c2-1b65-41a3-b2b6-5098ae0a0c8c', 'f16912d4-a240-460f-8336-51b30af1a562', '957ac657-3b87-443d-b629-8d074d2f0eae'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:10 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c764b64f-cd6a-4ba7-a079-f87f1f44da02 tempest-ProjectReaderTests-1512630701 None] Delete snapshot completed successfully.
Nov 07 02:53:10 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-c764b64f-cd6a-4ba7-a079-f87f1f44da02 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-de59eaa6-fc0f-45f0-9082-a6cfaca4018a-delete_snapshot" released by "delete_snapshot" :: held 1.785s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:10 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a03713a7-f5f8-421b-a088-29ccbd989bf1 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-23a55bb1-199b-42ac-8477-c12e313d3e4f-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:10 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a03713a7-f5f8-421b-a088-29ccbd989bf1 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-23a55bb1-199b-42ac-8477-c12e313d3e4f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:10 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a03713a7-f5f8-421b-a088-29ccbd989bf1 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "cinder-quobyte-23a55bb1-199b-42ac-8477-c12e313d3e4f" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:10 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a03713a7-f5f8-421b-a088-29ccbd989bf1 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-23a55bb1-199b-42ac-8477-c12e313d3e4f" acquired by "delete_volume" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:10 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb967c10-6867-4f11-b378-4bafc4376113]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:10 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a03713a7-f5f8-421b-a088-29ccbd989bf1 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:10 devstack sudo[108703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f
Nov 07 02:53:10 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:11 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a03713a7-f5f8-421b-a088-29ccbd989bf1 tempest-ProjectReaderTests-1512630701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f" returned: 0 in 0.374s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a03713a7-f5f8-421b-a088-29ccbd989bf1 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:11 devstack sudo[108708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f
Nov 07 02:53:11 devstack sudo[108708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1d7f8367-d316-4942-b983-4e2e0faa7b44 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1d7f8367-d316-4942-b983-4e2e0faa7b44 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-1d7f8367-d316-4942-b983-4e2e0faa7b44 tempest-ProjectMemberTests-1907878748 None] Creating offline snapshot 39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf of volume 857b580c-4261-410a-a632-3c550595ed05 {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:53:11 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8cb1fe-37df-4963-b249-08bb2b2f15c3]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1d7f8367-d316-4942-b983-4e2e0faa7b44 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:11 devstack sudo[108708]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a03713a7-f5f8-421b-a088-29ccbd989bf1 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-23a55bb1-199b-42ac-8477-c12e313d3e4f" returned: 0 in 0.285s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:11 devstack sudo[108710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05
Nov 07 02:53:11 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:11 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a03713a7-f5f8-421b-a088-29ccbd989bf1 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-quobyte-23a55bb1-199b-42ac-8477-c12e313d3e4f" released by "delete_volume" :: held 0.730s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:11 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-a03713a7-f5f8-421b-a088-29ccbd989bf1 tempest-ProjectReaderTests-1512630701 None] Created reservations ['953942f7-cd8e-429e-ac69-5f34384b78b3', '5e3e208b-e5b1-4270-b23c-6af50098d3da', 'dbb982be-0869-4cc9-844a-b3af0edc6349', '18217d6c-be45-4a36-8a78-ab171d73df53'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a03713a7-f5f8-421b-a088-29ccbd989bf1 tempest-ProjectReaderTests-1512630701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a03713a7-f5f8-421b-a088-29ccbd989bf1 tempest-ProjectReaderTests-1512630701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a03713a7-f5f8-421b-a088-29ccbd989bf1 tempest-ProjectReaderTests-1512630701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:11 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-a03713a7-f5f8-421b-a088-29ccbd989bf1 tempest-ProjectReaderTests-1512630701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-a03713a7-f5f8-421b-a088-29ccbd989bf1 tempest-ProjectReaderTests-1512630701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a03713a7-f5f8-421b-a088-29ccbd989bf1 tempest-ProjectReaderTests-1512630701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:11 devstack sudo[108713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:53:11 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:11 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1d7f8367-d316-4942-b983-4e2e0faa7b44 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05" returned: 0 in 0.389s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1d7f8367-d316-4942-b983-4e2e0faa7b44 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:11 devstack sudo[108718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf 1G
Nov 07 02:53:11 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:11 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:11 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-a03713a7-f5f8-421b-a088-29ccbd989bf1 tempest-ProjectReaderTests-1512630701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.271s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:11 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-a03713a7-f5f8-421b-a088-29ccbd989bf1 tempest-ProjectReaderTests-1512630701 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:11 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-a03713a7-f5f8-421b-a088-29ccbd989bf1 tempest-ProjectReaderTests-1512630701 None] Deleted volume successfully.
Nov 07 02:53:11 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-a03713a7-f5f8-421b-a088-29ccbd989bf1 tempest-ProjectReaderTests-1512630701 None] Lock "cinder-23a55bb1-199b-42ac-8477-c12e313d3e4f-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:12 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1d7f8367-d316-4942-b983-4e2e0faa7b44 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf 1G" returned: 0 in 0.485s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1d7f8367-d316-4942-b983-4e2e0faa7b44 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-857b580c-4261-410a-a632-3c550595ed05 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:12 devstack sudo[108725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-857b580c-4261-410a-a632-3c550595ed05 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf
Nov 07 02:53:12 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:12 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1d7f8367-d316-4942-b983-4e2e0faa7b44 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-857b580c-4261-410a-a632-3c550595ed05 -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf" returned: 0 in 0.316s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:12 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-1d7f8367-d316-4942-b983-4e2e0faa7b44 tempest-ProjectMemberTests-1907878748 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf is being set with open permissions: ugo+rw
Nov 07 02:53:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1d7f8367-d316-4942-b983-4e2e0faa7b44 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:12 devstack sudo[108730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf
Nov 07 02:53:12 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:12 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1d7f8367-d316-4942-b983-4e2e0faa7b44 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf" returned: 0 in 0.260s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:12 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1d7f8367-d316-4942-b983-4e2e0faa7b44 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:12 devstack sudo[108733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.info
Nov 07 02:53:12 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:13 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1d7f8367-d316-4942-b983-4e2e0faa7b44 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.info" returned: 0 in 0.285s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:13 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-1d7f8367-d316-4942-b983-4e2e0faa7b44 tempest-ProjectMemberTests-1907878748 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.info is being set with open permissions: ugo+rw
Nov 07 02:53:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1d7f8367-d316-4942-b983-4e2e0faa7b44 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:13 devstack sudo[108736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.info
Nov 07 02:53:13 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:13 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1d7f8367-d316-4942-b983-4e2e0faa7b44 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.info" returned: 0 in 0.279s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:13 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1d7f8367-d316-4942-b983-4e2e0faa7b44 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:13 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=180,cinder:UPDATE=236,cinder:INSERT=70,cinder:DELETE=16 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:53:13 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-1d7f8367-d316-4942-b983-4e2e0faa7b44 tempest-ProjectMemberTests-1907878748 None] Create snapshot completed successfully
Nov 07 02:53:14 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3c034afe-32af-4e99-9520-99e8f137832b tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:14 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3c034afe-32af-4e99-9520-99e8f137832b tempest-ProjectMemberTests-1907878748 None] Lock "cinder-39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:14 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3c034afe-32af-4e99-9520-99e8f137832b tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-857b580c-4261-410a-a632-3c550595ed05" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:14 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3c034afe-32af-4e99-9520-99e8f137832b tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-857b580c-4261-410a-a632-3c550595ed05" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:14 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3c034afe-32af-4e99-9520-99e8f137832b tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:14 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3c034afe-32af-4e99-9520-99e8f137832b tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-3c034afe-32af-4e99-9520-99e8f137832b tempest-ProjectMemberTests-1907878748 None] Deleting offline snapshot 39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf of volume 857b580c-4261-410a-a632-3c550595ed05 {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:53:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-3c034afe-32af-4e99-9520-99e8f137832b tempest-ProjectMemberTests-1907878748 None] snapshot_file for this snap is: volume-857b580c-4261-410a-a632-3c550595ed05.39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:53:14 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a256c03-bc93-44ac-bdff-c06c9623c758]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3c034afe-32af-4e99-9520-99e8f137832b tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:14 devstack sudo[108739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf
Nov 07 02:53:14 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:14 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3c034afe-32af-4e99-9520-99e8f137832b tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf" returned: 0 in 0.374s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:14 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-3c034afe-32af-4e99-9520-99e8f137832b tempest-ProjectMemberTests-1907878748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-857b580c-4261-410a-a632-3c550595ed05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:53:14 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[64526c97-999a-44dc-9aba-8f21ba2a40ae]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:14 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3c034afe-32af-4e99-9520-99e8f137832b tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:15 devstack sudo[108744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05
Nov 07 02:53:15 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:15 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3c034afe-32af-4e99-9520-99e8f137832b tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05" returned: 0 in 0.389s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3c034afe-32af-4e99-9520-99e8f137832b tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:15 devstack sudo[108757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf
Nov 07 02:53:15 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Flow 'volume_create_manager' (bc8d4811-3d43-440d-a6d0-24fe156f3481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (802a4451-8c69-4ae5-975b-4ab9b7fa8faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (802a4451-8c69-4ae5-975b-4ab9b7fa8faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1552133599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c3a423-e327-4b3f-8c87-2832c555b48a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e8a03d7ae9464da2a64d9846ed78f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:16Z,use_quota=True,user_id='e4e0f8ef5bdf4be7857314063465a81c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5862799-c474-45d1-8b0c-0ffeb6c85ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5862799-c474-45d1-8b0c-0ffeb6c85ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea03b3df-46d9-4b3f-9046-6baf43158dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea03b3df-46d9-4b3f-9046-6baf43158dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9c3a423-e327-4b3f-8c87-2832c555b48a', 'volume_name': 'volume-e9c3a423-e327-4b3f-8c87-2832c555b48a', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:15 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a32f89fb-2041-4153-8c96-291f74969bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a32f89fb-2041-4153-8c96-291f74969bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f626e325-40f0-4cfb-8d2c-d3ae50bbb9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:15 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Volume e9c3a423-e327-4b3f-8c87-2832c555b48a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9c3a423-e327-4b3f-8c87-2832c555b48a', 'volume_size': 1}
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1552133599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c3a423-e327-4b3f-8c87-2832c555b48a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e8a03d7ae9464da2a64d9846ed78f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:16Z,use_quota=True,user_id='e4e0f8ef5bdf4be7857314063465a81c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Creating volume e9c3a423-e327-4b3f-8c87-2832c555b48a {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:53:15 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e9c3a423-e327-4b3f-8c87-2832c555b48a 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3c034afe-32af-4e99-9520-99e8f137832b tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf" returned: 0 in 0.466s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:15 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3c034afe-32af-4e99-9520-99e8f137832b tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:15 devstack sudo[108762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e9c3a423-e327-4b3f-8c87-2832c555b48a 1073741824
Nov 07 02:53:15 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:15 devstack sudo[108763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf
Nov 07 02:53:15 devstack sudo[108763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:16 devstack sudo[108763]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3c034afe-32af-4e99-9520-99e8f137832b tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05.39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf" returned: 0 in 0.252s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3c034afe-32af-4e99-9520-99e8f137832b tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf" released by "_delete_snapshot" :: held 1.599s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3c034afe-32af-4e99-9520-99e8f137832b tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-857b580c-4261-410a-a632-3c550595ed05" released by "delete_snapshot" :: held 1.623s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-3c034afe-32af-4e99-9520-99e8f137832b tempest-ProjectMemberTests-1907878748 None] Created reservations ['12fb2783-a6e8-4fad-ad02-708ae335f94e', '96986f13-e6bf-497b-9a36-32aa3cda0da4', 'fdf35610-9a36-4cd9-bcbe-7b488a3b66e2', 'd9345734-707b-4c6e-a752-49c181ba60c1'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:16 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-3c034afe-32af-4e99-9520-99e8f137832b tempest-ProjectMemberTests-1907878748 None] Delete snapshot completed successfully.
Nov 07 02:53:16 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e9c3a423-e327-4b3f-8c87-2832c555b48a 1073741824" returned: 0 in 0.437s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3c034afe-32af-4e99-9520-99e8f137832b tempest-ProjectMemberTests-1907878748 None] Lock "cinder-39f9e7f0-2e35-44fd-96bf-b8e0b30ce2bf-delete_snapshot" released by "delete_snapshot" :: held 1.775s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e9c3a423-e327-4b3f-8c87-2832c555b48a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:16 devstack sudo[108771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e9c3a423-e327-4b3f-8c87-2832c555b48a
Nov 07 02:53:16 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:16 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e9c3a423-e327-4b3f-8c87-2832c555b48a" returned: 0 in 0.243s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f626e325-40f0-4cfb-8d2c-d3ae50bbb9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9c3a423-e327-4b3f-8c87-2832c555b48a', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6fbb58-9d0f-4504-bbc9-29e825768a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:16 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Volume volume-e9c3a423-e327-4b3f-8c87-2832c555b48a (e9c3a423-e327-4b3f-8c87-2832c555b48a): created successfully
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6fbb58-9d0f-4504-bbc9-29e825768a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Flow 'volume_create_manager' (bc8d4811-3d43-440d-a6d0-24fe156f3481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:16 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-0ee6d43c-4a59-4762-a96f-31e2ee91b0a2 tempest-ProjectReaderTests-1696011486 None] Created volume successfully.
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-532bba90-6faf-4b78-b617-6ff086b80da5 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-857b580c-4261-410a-a632-3c550595ed05-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-532bba90-6faf-4b78-b617-6ff086b80da5 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-857b580c-4261-410a-a632-3c550595ed05-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-532bba90-6faf-4b78-b617-6ff086b80da5 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-857b580c-4261-410a-a632-3c550595ed05" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-532bba90-6faf-4b78-b617-6ff086b80da5 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-857b580c-4261-410a-a632-3c550595ed05" acquired by "delete_volume" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1a8d4a-1685-47ae-9184-5646cc56c56a]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-532bba90-6faf-4b78-b617-6ff086b80da5 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ba010852-60ca-425c-917f-29f74775241c tempest-ProjectReaderTests-1696011486 None] Acquiring lock "cinder-e9c3a423-e327-4b3f-8c87-2832c555b48a-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:16 devstack sudo[108774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05
Nov 07 02:53:16 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ba010852-60ca-425c-917f-29f74775241c tempest-ProjectReaderTests-1696011486 None] Lock "cinder-e9c3a423-e327-4b3f-8c87-2832c555b48a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ba010852-60ca-425c-917f-29f74775241c tempest-ProjectReaderTests-1696011486 None] Acquiring lock "cinder-quobyte-e9c3a423-e327-4b3f-8c87-2832c555b48a" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ba010852-60ca-425c-917f-29f74775241c tempest-ProjectReaderTests-1696011486 None] Lock "cinder-quobyte-e9c3a423-e327-4b3f-8c87-2832c555b48a" acquired by "delete_volume" :: waited 0.021s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae00568-f1df-4d63-afe9-02156cb08a53]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:16 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ba010852-60ca-425c-917f-29f74775241c tempest-ProjectReaderTests-1696011486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e9c3a423-e327-4b3f-8c87-2832c555b48a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:17 devstack sudo[108776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e9c3a423-e327-4b3f-8c87-2832c555b48a
Nov 07 02:53:17 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:17 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-532bba90-6faf-4b78-b617-6ff086b80da5 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05" returned: 0 in 0.380s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-532bba90-6faf-4b78-b617-6ff086b80da5 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:17 devstack sudo[108781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05
Nov 07 02:53:17 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:17 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ba010852-60ca-425c-917f-29f74775241c tempest-ProjectReaderTests-1696011486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e9c3a423-e327-4b3f-8c87-2832c555b48a" returned: 0 in 0.384s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ba010852-60ca-425c-917f-29f74775241c tempest-ProjectReaderTests-1696011486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e9c3a423-e327-4b3f-8c87-2832c555b48a {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:17 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-532bba90-6faf-4b78-b617-6ff086b80da5 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-857b580c-4261-410a-a632-3c550595ed05" returned: 0 in 0.256s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:17 devstack sudo[108787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e9c3a423-e327-4b3f-8c87-2832c555b48a
Nov 07 02:53:17 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-532bba90-6faf-4b78-b617-6ff086b80da5 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-857b580c-4261-410a-a632-3c550595ed05" released by "delete_volume" :: held 0.704s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-532bba90-6faf-4b78-b617-6ff086b80da5 tempest-ProjectMemberTests-1907878748 None] Created reservations ['96efd0af-9955-43b9-bdc9-6b106f5414fb', 'aac864ae-841e-45a1-9343-22fcf3ad89c2', '2fc35242-1a40-43d3-85e2-6489cc19ac91', '03b88bb3-7f3d-404c-9bec-3a21eceb3c2e'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-532bba90-6faf-4b78-b617-6ff086b80da5 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-532bba90-6faf-4b78-b617-6ff086b80da5 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-532bba90-6faf-4b78-b617-6ff086b80da5 tempest-ProjectMemberTests-1907878748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-532bba90-6faf-4b78-b617-6ff086b80da5 tempest-ProjectMemberTests-1907878748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-532bba90-6faf-4b78-b617-6ff086b80da5 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-532bba90-6faf-4b78-b617-6ff086b80da5 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:17 devstack sudo[108789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:53:17 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:17 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ba010852-60ca-425c-917f-29f74775241c tempest-ProjectReaderTests-1696011486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e9c3a423-e327-4b3f-8c87-2832c555b48a" returned: 0 in 0.258s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ba010852-60ca-425c-917f-29f74775241c tempest-ProjectReaderTests-1696011486 None] Lock "cinder-quobyte-e9c3a423-e327-4b3f-8c87-2832c555b48a" released by "delete_volume" :: held 0.694s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-ba010852-60ca-425c-917f-29f74775241c tempest-ProjectReaderTests-1696011486 None] Created reservations ['cf79bb0a-756e-441f-a39d-66ed6259817f', 'f97102d1-ed25-4d0f-b5ef-e144b6ccf770', 'af9fcd29-0108-4c33-b628-4a3af97871d6', '947c0aba-0bab-4c44-9cff-b79643837a70'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ba010852-60ca-425c-917f-29f74775241c tempest-ProjectReaderTests-1696011486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ba010852-60ca-425c-917f-29f74775241c tempest-ProjectReaderTests-1696011486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ba010852-60ca-425c-917f-29f74775241c tempest-ProjectReaderTests-1696011486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-ba010852-60ca-425c-917f-29f74775241c tempest-ProjectReaderTests-1696011486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-ba010852-60ca-425c-917f-29f74775241c tempest-ProjectReaderTests-1696011486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ba010852-60ca-425c-917f-29f74775241c tempest-ProjectReaderTests-1696011486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:17 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-532bba90-6faf-4b78-b617-6ff086b80da5 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.269s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:17 devstack sudo[108793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:53:17 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-532bba90-6faf-4b78-b617-6ff086b80da5 tempest-ProjectMemberTests-1907878748 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:17 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-532bba90-6faf-4b78-b617-6ff086b80da5 tempest-ProjectMemberTests-1907878748 None] Deleted volume successfully.
Nov 07 02:53:17 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-532bba90-6faf-4b78-b617-6ff086b80da5 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-857b580c-4261-410a-a632-3c550595ed05-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:18 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-ba010852-60ca-425c-917f-29f74775241c tempest-ProjectReaderTests-1696011486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.279s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-ba010852-60ca-425c-917f-29f74775241c tempest-ProjectReaderTests-1696011486 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:18 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-ba010852-60ca-425c-917f-29f74775241c tempest-ProjectReaderTests-1696011486 None] Deleted volume successfully.
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-ba010852-60ca-425c-917f-29f74775241c tempest-ProjectReaderTests-1696011486 None] Lock "cinder-e9c3a423-e327-4b3f-8c87-2832c555b48a-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Flow 'volume_create_manager' (a2f951f2-f9ab-426b-9356-4ff08b0555ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18af993d-bb1a-459d-a001-26a601b6db95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18af993d-bb1a-459d-a001-26a601b6db95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1146386198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d05f43-9398-43ce-8acc-94c2ebd9388f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90854e8da8b14aa28568e8beba706c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:18Z,use_quota=True,user_id='813ad50b030d4d3fac7f68412673b863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b917a606-cbf2-49e3-b514-e0013fb1e8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b917a606-cbf2-49e3-b514-e0013fb1e8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abcdeca-cf4c-4a9e-97f2-f0d4d969f51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abcdeca-cf4c-4a9e-97f2-f0d4d969f51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3d05f43-9398-43ce-8acc-94c2ebd9388f', 'volume_name': 'volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab97543-cf70-4589-8dd2-6108f8ef8c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab97543-cf70-4589-8dd2-6108f8ef8c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1384fb0-62b4-4810-a9a6-45cc6876e9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:18 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Volume e3d05f43-9398-43ce-8acc-94c2ebd9388f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f', 'volume_size': 1}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1146386198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d05f43-9398-43ce-8acc-94c2ebd9388f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90854e8da8b14aa28568e8beba706c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:18Z,use_quota=True,user_id='813ad50b030d4d3fac7f68412673b863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Creating volume e3d05f43-9398-43ce-8acc-94c2ebd9388f {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:53:18 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:18 devstack sudo[108797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f 1073741824
Nov 07 02:53:18 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Flow 'volume_create_manager' (6c4218ae-4628-4540-9d0e-acac41aee8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841cf5c6-da0c-4e50-8051-2637d9dec068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841cf5c6-da0c-4e50-8051-2637d9dec068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1715361489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918ed8e5-eb45-40e3-948b-2015fceb0e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e8a03d7ae9464da2a64d9846ed78f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:19Z,use_quota=True,user_id='e4e0f8ef5bdf4be7857314063465a81c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6b9b59-8207-4053-a8fe-fcda58161391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6b9b59-8207-4053-a8fe-fcda58161391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8df3736-373a-4a19-9a20-aee377465197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8df3736-373a-4a19-9a20-aee377465197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '918ed8e5-eb45-40e3-948b-2015fceb0e0f', 'volume_name': 'volume-918ed8e5-eb45-40e3-948b-2015fceb0e0f', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e99ea42-47f7-43ef-941c-c7e60b15c7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e99ea42-47f7-43ef-941c-c7e60b15c7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea02b7b-84ad-4832-b203-6375f3deaa73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:18 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Volume 918ed8e5-eb45-40e3-948b-2015fceb0e0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-918ed8e5-eb45-40e3-948b-2015fceb0e0f', 'volume_size': 1}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:18 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f 1073741824" returned: 0 in 0.439s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:18 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:18 devstack sudo[108803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f
Nov 07 02:53:18 devstack sudo[108803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:19 devstack sudo[108803]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f" returned: 0 in 0.254s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.500s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1715361489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918ed8e5-eb45-40e3-948b-2015fceb0e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e8a03d7ae9464da2a64d9846ed78f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:19Z,use_quota=True,user_id='e4e0f8ef5bdf4be7857314063465a81c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Creating volume 918ed8e5-eb45-40e3-948b-2015fceb0e0f {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:53:19 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-918ed8e5-eb45-40e3-948b-2015fceb0e0f 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1384fb0-62b4-4810-a9a6-45cc6876e9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7436ee10-5ef4-47ff-b3f5-252fe9be904e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:19 devstack sudo[108806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-918ed8e5-eb45-40e3-948b-2015fceb0e0f 1073741824
Nov 07 02:53:19 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:19 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Volume volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f (e3d05f43-9398-43ce-8acc-94c2ebd9388f): created successfully
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7436ee10-5ef4-47ff-b3f5-252fe9be904e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Flow 'volume_create_manager' (a2f951f2-f9ab-426b-9356-4ff08b0555ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:19 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-859d90c9-00e4-41b0-8aa2-a08c9bf5c575 tempest-ProjectMemberTests-1907878748 None] Created volume successfully.
Nov 07 02:53:19 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-918ed8e5-eb45-40e3-948b-2015fceb0e0f 1073741824" returned: 0 in 0.429s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-918ed8e5-eb45-40e3-948b-2015fceb0e0f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:19 devstack sudo[108812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-918ed8e5-eb45-40e3-948b-2015fceb0e0f
Nov 07 02:53:19 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:19 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-918ed8e5-eb45-40e3-948b-2015fceb0e0f" returned: 0 in 0.245s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea02b7b-84ad-4832-b203-6375f3deaa73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-918ed8e5-eb45-40e3-948b-2015fceb0e0f', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929feed6-3795-46ab-8b2e-f09869793deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:19 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Volume volume-918ed8e5-eb45-40e3-948b-2015fceb0e0f (918ed8e5-eb45-40e3-948b-2015fceb0e0f): created successfully
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929feed6-3795-46ab-8b2e-f09869793deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:19 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Flow 'volume_create_manager' (6c4218ae-4628-4540-9d0e-acac41aee8b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:19 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-3cb1a9ec-3722-4809-9ada-cc30a4bcfe00 tempest-ProjectReaderTests-1696011486 None] Created volume successfully.
Nov 07 02:53:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1129ca02-3419-4ea4-a20f-cbeb4ca7298a tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1129ca02-3419-4ea4-a20f-cbeb4ca7298a tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:20 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-1129ca02-3419-4ea4-a20f-cbeb4ca7298a tempest-ProjectMemberTests-1907878748 None] Creating offline snapshot a28050af-a0d3-4fe2-908f-67be51d803da of volume e3d05f43-9398-43ce-8acc-94c2ebd9388f {{(pid=87054) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 07 02:53:20 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e74bfb7-4312-492c-8898-dbcd13dde97f]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1129ca02-3419-4ea4-a20f-cbeb4ca7298a tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:20 devstack sudo[108815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f
Nov 07 02:53:20 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5b5fa855-d8aa-44bd-bcdb-8b7c751f9bc9 tempest-ProjectReaderTests-1696011486 None] Acquiring lock "cinder-918ed8e5-eb45-40e3-948b-2015fceb0e0f-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5b5fa855-d8aa-44bd-bcdb-8b7c751f9bc9 tempest-ProjectReaderTests-1696011486 None] Lock "cinder-918ed8e5-eb45-40e3-948b-2015fceb0e0f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5b5fa855-d8aa-44bd-bcdb-8b7c751f9bc9 tempest-ProjectReaderTests-1696011486 None] Acquiring lock "cinder-quobyte-918ed8e5-eb45-40e3-948b-2015fceb0e0f" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:20 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5b5fa855-d8aa-44bd-bcdb-8b7c751f9bc9 tempest-ProjectReaderTests-1696011486 None] Lock "cinder-quobyte-918ed8e5-eb45-40e3-948b-2015fceb0e0f" acquired by "delete_volume" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:20 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[91be9b57-9796-4881-bba5-3d70ee9d6a01]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5b5fa855-d8aa-44bd-bcdb-8b7c751f9bc9 tempest-ProjectReaderTests-1696011486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-918ed8e5-eb45-40e3-948b-2015fceb0e0f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:20 devstack sudo[108817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-918ed8e5-eb45-40e3-948b-2015fceb0e0f
Nov 07 02:53:20 devstack sudo[108817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:20 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1129ca02-3419-4ea4-a20f-cbeb4ca7298a tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f" returned: 0 in 0.403s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:20 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1129ca02-3419-4ea4-a20f-cbeb4ca7298a tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.a28050af-a0d3-4fe2-908f-67be51d803da 1G {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:20 devstack sudo[108822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.a28050af-a0d3-4fe2-908f-67be51d803da 1G
Nov 07 02:53:20 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:21 devstack sudo[108817]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5b5fa855-d8aa-44bd-bcdb-8b7c751f9bc9 tempest-ProjectReaderTests-1696011486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-918ed8e5-eb45-40e3-948b-2015fceb0e0f" returned: 0 in 0.377s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5b5fa855-d8aa-44bd-bcdb-8b7c751f9bc9 tempest-ProjectReaderTests-1696011486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-918ed8e5-eb45-40e3-948b-2015fceb0e0f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:21 devstack sudo[108829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-918ed8e5-eb45-40e3-948b-2015fceb0e0f
Nov 07 02:53:21 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:21 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1129ca02-3419-4ea4-a20f-cbeb4ca7298a tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.a28050af-a0d3-4fe2-908f-67be51d803da 1G" returned: 0 in 0.422s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1129ca02-3419-4ea4-a20f-cbeb4ca7298a tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.a28050af-a0d3-4fe2-908f-67be51d803da {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:21 devstack sudo[108833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.a28050af-a0d3-4fe2-908f-67be51d803da
Nov 07 02:53:21 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:21 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5b5fa855-d8aa-44bd-bcdb-8b7c751f9bc9 tempest-ProjectReaderTests-1696011486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-918ed8e5-eb45-40e3-948b-2015fceb0e0f" returned: 0 in 0.277s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5b5fa855-d8aa-44bd-bcdb-8b7c751f9bc9 tempest-ProjectReaderTests-1696011486 None] Lock "cinder-quobyte-918ed8e5-eb45-40e3-948b-2015fceb0e0f" released by "delete_volume" :: held 0.706s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:21 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-5b5fa855-d8aa-44bd-bcdb-8b7c751f9bc9 tempest-ProjectReaderTests-1696011486 None] Created reservations ['ca93b053-7935-4456-aad6-9db1b64e7121', '5e3ca8f1-faa3-4296-bdbe-7e438220fed2', '210174d7-5101-49c1-959d-71860eaa7621', 'e402b31b-f496-42f7-9c03-256780d66972'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5b5fa855-d8aa-44bd-bcdb-8b7c751f9bc9 tempest-ProjectReaderTests-1696011486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5b5fa855-d8aa-44bd-bcdb-8b7c751f9bc9 tempest-ProjectReaderTests-1696011486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:21 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5b5fa855-d8aa-44bd-bcdb-8b7c751f9bc9 tempest-ProjectReaderTests-1696011486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:21 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-5b5fa855-d8aa-44bd-bcdb-8b7c751f9bc9 tempest-ProjectReaderTests-1696011486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-5b5fa855-d8aa-44bd-bcdb-8b7c751f9bc9 tempest-ProjectReaderTests-1696011486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5b5fa855-d8aa-44bd-bcdb-8b7c751f9bc9 tempest-ProjectReaderTests-1696011486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:21 devstack sudo[108838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:53:21 devstack sudo[108838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:21 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1129ca02-3419-4ea4-a20f-cbeb4ca7298a tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f -F qcow2 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.a28050af-a0d3-4fe2-908f-67be51d803da" returned: 0 in 0.316s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:21 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-1129ca02-3419-4ea4-a20f-cbeb4ca7298a tempest-ProjectMemberTests-1907878748 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.a28050af-a0d3-4fe2-908f-67be51d803da is being set with open permissions: ugo+rw
Nov 07 02:53:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1129ca02-3419-4ea4-a20f-cbeb4ca7298a tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.a28050af-a0d3-4fe2-908f-67be51d803da {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:21 devstack sudo[108841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.a28050af-a0d3-4fe2-908f-67be51d803da
Nov 07 02:53:21 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:21 devstack sudo[108838]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-5b5fa855-d8aa-44bd-bcdb-8b7c751f9bc9 tempest-ProjectReaderTests-1696011486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.263s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:21 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-5b5fa855-d8aa-44bd-bcdb-8b7c751f9bc9 tempest-ProjectReaderTests-1696011486 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:21 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-5b5fa855-d8aa-44bd-bcdb-8b7c751f9bc9 tempest-ProjectReaderTests-1696011486 None] Deleted volume successfully.
Nov 07 02:53:21 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-5b5fa855-d8aa-44bd-bcdb-8b7c751f9bc9 tempest-ProjectReaderTests-1696011486 None] Lock "cinder-918ed8e5-eb45-40e3-948b-2015fceb0e0f-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:21 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1129ca02-3419-4ea4-a20f-cbeb4ca7298a tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.a28050af-a0d3-4fe2-908f-67be51d803da" returned: 0 in 0.293s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:21 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1129ca02-3419-4ea4-a20f-cbeb4ca7298a tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:22 devstack sudo[108845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.info
Nov 07 02:53:22 devstack sudo[108845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:22 devstack sudo[108845]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1129ca02-3419-4ea4-a20f-cbeb4ca7298a tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.info" returned: 0 in 0.276s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:22 devstack cinder-volume[87054]: WARNING cinder.volume.drivers.remotefs [None req-1129ca02-3419-4ea4-a20f-cbeb4ca7298a tempest-ProjectMemberTests-1907878748 None] /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.info is being set with open permissions: ugo+rw
Nov 07 02:53:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1129ca02-3419-4ea4-a20f-cbeb4ca7298a tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.info {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:22 devstack sudo[108848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.info
Nov 07 02:53:22 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:22 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-1129ca02-3419-4ea4-a20f-cbeb4ca7298a tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.info" returned: 0 in 0.291s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:22 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-1129ca02-3419-4ea4-a20f-cbeb4ca7298a tempest-ProjectMemberTests-1907878748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.093s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:22 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-1129ca02-3419-4ea4-a20f-cbeb4ca7298a tempest-ProjectMemberTests-1907878748 None] Create snapshot completed successfully
Nov 07 02:53:23 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-60980fbb-ccd2-4f6c-b80a-dd1a13e67852 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-a28050af-a0d3-4fe2-908f-67be51d803da-delete_snapshot" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:23 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-60980fbb-ccd2-4f6c-b80a-dd1a13e67852 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-a28050af-a0d3-4fe2-908f-67be51d803da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:23 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-60980fbb-ccd2-4f6c-b80a-dd1a13e67852 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-e3d05f43-9398-43ce-8acc-94c2ebd9388f" by "delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:23 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-60980fbb-ccd2-4f6c-b80a-dd1a13e67852 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-e3d05f43-9398-43ce-8acc-94c2ebd9388f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:23 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-60980fbb-ccd2-4f6c-b80a-dd1a13e67852 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-a28050af-a0d3-4fe2-908f-67be51d803da" by "_delete_snapshot" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:23 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-60980fbb-ccd2-4f6c-b80a-dd1a13e67852 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-a28050af-a0d3-4fe2-908f-67be51d803da" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-60980fbb-ccd2-4f6c-b80a-dd1a13e67852 tempest-ProjectMemberTests-1907878748 None] Deleting offline snapshot a28050af-a0d3-4fe2-908f-67be51d803da of volume e3d05f43-9398-43ce-8acc-94c2ebd9388f {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 07 02:53:23 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-60980fbb-ccd2-4f6c-b80a-dd1a13e67852 tempest-ProjectMemberTests-1907878748 None] snapshot_file for this snap is: volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.a28050af-a0d3-4fe2-908f-67be51d803da {{(pid=87054) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 07 02:53:23 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e92507-b722-459c-925e-1fedcf8bf786]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:23 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-60980fbb-ccd2-4f6c-b80a-dd1a13e67852 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.a28050af-a0d3-4fe2-908f-67be51d803da {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:23 devstack sudo[108851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.a28050af-a0d3-4fe2-908f-67be51d803da
Nov 07 02:53:23 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:24 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-60980fbb-ccd2-4f6c-b80a-dd1a13e67852 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.a28050af-a0d3-4fe2-908f-67be51d803da" returned: 0 in 0.354s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:24 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-60980fbb-ccd2-4f6c-b80a-dd1a13e67852 tempest-ProjectMemberTests-1907878748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87054) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 07 02:53:24 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[02901134-ac78-4b6d-84a1-ddc23c9c66c3]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-60980fbb-ccd2-4f6c-b80a-dd1a13e67852 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:24 devstack sudo[108856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f
Nov 07 02:53:24 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:24 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-60980fbb-ccd2-4f6c-b80a-dd1a13e67852 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f" returned: 0 in 0.347s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-60980fbb-ccd2-4f6c-b80a-dd1a13e67852 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.a28050af-a0d3-4fe2-908f-67be51d803da {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:24 devstack sudo[108861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.a28050af-a0d3-4fe2-908f-67be51d803da
Nov 07 02:53:24 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:24 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-60980fbb-ccd2-4f6c-b80a-dd1a13e67852 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.a28050af-a0d3-4fe2-908f-67be51d803da" returned: 0 in 0.325s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:24 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-60980fbb-ccd2-4f6c-b80a-dd1a13e67852 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.a28050af-a0d3-4fe2-908f-67be51d803da {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:24 devstack sudo[108866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.a28050af-a0d3-4fe2-908f-67be51d803da
Nov 07 02:53:24 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:25 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:25 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-60980fbb-ccd2-4f6c-b80a-dd1a13e67852 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f.a28050af-a0d3-4fe2-908f-67be51d803da" returned: 0 in 0.240s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-60980fbb-ccd2-4f6c-b80a-dd1a13e67852 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-a28050af-a0d3-4fe2-908f-67be51d803da" released by "_delete_snapshot" :: held 1.363s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-60980fbb-ccd2-4f6c-b80a-dd1a13e67852 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-e3d05f43-9398-43ce-8acc-94c2ebd9388f" released by "delete_snapshot" :: held 1.383s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:25 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-60980fbb-ccd2-4f6c-b80a-dd1a13e67852 tempest-ProjectMemberTests-1907878748 None] Created reservations ['07ed12f6-6024-42c6-bba0-261146afafca', '6dbbabad-72bc-49f7-b02b-4f696229228a', 'c31b6419-6267-42f7-a647-5128e9d1e391', '20c11a0f-286e-4124-bfc1-3092589f7131'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:25 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-60980fbb-ccd2-4f6c-b80a-dd1a13e67852 tempest-ProjectMemberTests-1907878748 None] Delete snapshot completed successfully.
Nov 07 02:53:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-60980fbb-ccd2-4f6c-b80a-dd1a13e67852 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-a28050af-a0d3-4fe2-908f-67be51d803da-delete_snapshot" released by "delete_snapshot" :: held 1.513s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b71b7a7d-cc01-4281-bab0-7c71c7a02302 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-e3d05f43-9398-43ce-8acc-94c2ebd9388f-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b71b7a7d-cc01-4281-bab0-7c71c7a02302 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-e3d05f43-9398-43ce-8acc-94c2ebd9388f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b71b7a7d-cc01-4281-bab0-7c71c7a02302 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "cinder-quobyte-e3d05f43-9398-43ce-8acc-94c2ebd9388f" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:25 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b71b7a7d-cc01-4281-bab0-7c71c7a02302 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-e3d05f43-9398-43ce-8acc-94c2ebd9388f" acquired by "delete_volume" :: waited 0.014s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:26 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae3b176-9858-4f93-8ebf-d8cf4f836498]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b71b7a7d-cc01-4281-bab0-7c71c7a02302 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:26 devstack sudo[108869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f
Nov 07 02:53:26 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:26 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b71b7a7d-cc01-4281-bab0-7c71c7a02302 tempest-ProjectMemberTests-1907878748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f" returned: 0 in 0.350s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b71b7a7d-cc01-4281-bab0-7c71c7a02302 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:26 devstack sudo[108874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f
Nov 07 02:53:26 devstack sudo[108874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:26 devstack sudo[108874]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b71b7a7d-cc01-4281-bab0-7c71c7a02302 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-e3d05f43-9398-43ce-8acc-94c2ebd9388f" returned: 0 in 0.247s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:26 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b71b7a7d-cc01-4281-bab0-7c71c7a02302 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-quobyte-e3d05f43-9398-43ce-8acc-94c2ebd9388f" released by "delete_volume" :: held 0.659s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:26 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-b71b7a7d-cc01-4281-bab0-7c71c7a02302 tempest-ProjectMemberTests-1907878748 None] Created reservations ['d0e856b0-a5bb-4421-9d12-b81b7f2a9c93', '68c8d868-91aa-4bcd-be12-1eab04b80afd', '6a9c05ed-326f-4148-9c32-964b3e926e68', 'abc368c2-901c-416d-93e6-c8bde6504bc5'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b71b7a7d-cc01-4281-bab0-7c71c7a02302 tempest-ProjectMemberTests-1907878748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b71b7a7d-cc01-4281-bab0-7c71c7a02302 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b71b7a7d-cc01-4281-bab0-7c71c7a02302 tempest-ProjectMemberTests-1907878748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:26 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b71b7a7d-cc01-4281-bab0-7c71c7a02302 tempest-ProjectMemberTests-1907878748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b71b7a7d-cc01-4281-bab0-7c71c7a02302 tempest-ProjectMemberTests-1907878748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b71b7a7d-cc01-4281-bab0-7c71c7a02302 tempest-ProjectMemberTests-1907878748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:26 devstack sudo[108877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:53:26 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:26 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:26 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b71b7a7d-cc01-4281-bab0-7c71c7a02302 tempest-ProjectMemberTests-1907878748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.241s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:26 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-b71b7a7d-cc01-4281-bab0-7c71c7a02302 tempest-ProjectMemberTests-1907878748 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:26 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b71b7a7d-cc01-4281-bab0-7c71c7a02302 tempest-ProjectMemberTests-1907878748 None] Deleted volume successfully.
Nov 07 02:53:27 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-b71b7a7d-cc01-4281-bab0-7c71c7a02302 tempest-ProjectMemberTests-1907878748 None] Lock "cinder-e3d05f43-9398-43ce-8acc-94c2ebd9388f-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:36 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=41,cinder:INSERT=11,cinder:UPDATE=54,cinder:DELETE=3 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:53:36 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:INSERT=32,cinder:UPDATE=115,cinder:SELECT=83,cinder:DELETE=11 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:53:42 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:53:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Flow 'volume_create_manager' (bbb95e77-171e-4502-82db-5e817cea80c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673c34e6-f53d-4785-b600-836cab505ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673c34e6-f53d-4785-b600-836cab505ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1025859579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=427f0753-847b-4d66-a763-af5caf803df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9605b31c914456ca266e88630487c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:43Z,use_quota=True,user_id='b61253654ed54bc5a6c59a130bedb682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a8d8b1-c178-4bf1-b063-fdf95b19337f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a8d8b1-c178-4bf1-b063-fdf95b19337f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53355f30-5415-4d6a-8d23-ae84479fe540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53355f30-5415-4d6a-8d23-ae84479fe540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '427f0753-847b-4d66-a763-af5caf803df4', 'volume_name': 'volume-427f0753-847b-4d66-a763-af5caf803df4', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c094e6fe-8840-469f-aee7-686b4d3af439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c094e6fe-8840-469f-aee7-686b4d3af439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:42 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16a70aba-ea61-4296-8a65-5fcd00b61e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:42 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Volume 427f0753-847b-4d66-a763-af5caf803df4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-427f0753-847b-4d66-a763-af5caf803df4', 'volume_size': 1}
Nov 07 02:53:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:42 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1025859579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=427f0753-847b-4d66-a763-af5caf803df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9605b31c914456ca266e88630487c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:43Z,use_quota=True,user_id='b61253654ed54bc5a6c59a130bedb682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:53:42 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Creating volume 427f0753-847b-4d66-a763-af5caf803df4 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:53:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:42 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:42 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:42 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:53:42 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:53:42 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-427f0753-847b-4d66-a763-af5caf803df4 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:43 devstack sudo[108886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-427f0753-847b-4d66-a763-af5caf803df4 1073741824
Nov 07 02:53:43 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:43 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-427f0753-847b-4d66-a763-af5caf803df4 1073741824" returned: 0 in 0.409s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-427f0753-847b-4d66-a763-af5caf803df4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:43 devstack sudo[108891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-427f0753-847b-4d66-a763-af5caf803df4
Nov 07 02:53:43 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:43 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-427f0753-847b-4d66-a763-af5caf803df4" returned: 0 in 0.235s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:43 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:53:43 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16a70aba-ea61-4296-8a65-5fcd00b61e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-427f0753-847b-4d66-a763-af5caf803df4', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaff1ab5-0526-4137-808e-7b6800bac140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:43 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Volume volume-427f0753-847b-4d66-a763-af5caf803df4 (427f0753-847b-4d66-a763-af5caf803df4): created successfully
Nov 07 02:53:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaff1ab5-0526-4137-808e-7b6800bac140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:43 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Flow 'volume_create_manager' (bbb95e77-171e-4502-82db-5e817cea80c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:43 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-7584b533-1681-4249-a472-157d397c880e tempest-ProjectReaderTests-25573969 None] Created volume successfully.
Nov 07 02:53:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-38f6a3d9-8ba2-4f7d-90eb-fb57bbf0ad4a tempest-ProjectReaderTests-25573969 None] Acquiring lock "cinder-427f0753-847b-4d66-a763-af5caf803df4-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-38f6a3d9-8ba2-4f7d-90eb-fb57bbf0ad4a tempest-ProjectReaderTests-25573969 None] Lock "cinder-427f0753-847b-4d66-a763-af5caf803df4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-38f6a3d9-8ba2-4f7d-90eb-fb57bbf0ad4a tempest-ProjectReaderTests-25573969 None] Acquiring lock "cinder-quobyte-427f0753-847b-4d66-a763-af5caf803df4" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-38f6a3d9-8ba2-4f7d-90eb-fb57bbf0ad4a tempest-ProjectReaderTests-25573969 None] Lock "cinder-quobyte-427f0753-847b-4d66-a763-af5caf803df4" acquired by "delete_volume" :: waited 0.014s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:44 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[7926e672-0d24-47bb-8684-98bfff03eb65]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38f6a3d9-8ba2-4f7d-90eb-fb57bbf0ad4a tempest-ProjectReaderTests-25573969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-427f0753-847b-4d66-a763-af5caf803df4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:44 devstack sudo[108894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-427f0753-847b-4d66-a763-af5caf803df4
Nov 07 02:53:44 devstack sudo[108894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:44 devstack sudo[108894]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38f6a3d9-8ba2-4f7d-90eb-fb57bbf0ad4a tempest-ProjectReaderTests-25573969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-427f0753-847b-4d66-a763-af5caf803df4" returned: 0 in 0.358s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38f6a3d9-8ba2-4f7d-90eb-fb57bbf0ad4a tempest-ProjectReaderTests-25573969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-427f0753-847b-4d66-a763-af5caf803df4 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:44 devstack sudo[108899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-427f0753-847b-4d66-a763-af5caf803df4
Nov 07 02:53:44 devstack sudo[108899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:44 devstack sudo[108899]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38f6a3d9-8ba2-4f7d-90eb-fb57bbf0ad4a tempest-ProjectReaderTests-25573969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-427f0753-847b-4d66-a763-af5caf803df4" returned: 0 in 0.244s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:44 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-38f6a3d9-8ba2-4f7d-90eb-fb57bbf0ad4a tempest-ProjectReaderTests-25573969 None] Lock "cinder-quobyte-427f0753-847b-4d66-a763-af5caf803df4" released by "delete_volume" :: held 0.641s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:44 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-38f6a3d9-8ba2-4f7d-90eb-fb57bbf0ad4a tempest-ProjectReaderTests-25573969 None] Created reservations ['8ef7ae6c-34f8-4b99-aeda-ce75561fc418', '89e8f4e9-7213-42b8-900e-b1861b76771c', '50e9c24d-e976-44a6-a1b0-99e3fb129a3c', '9d5384ce-749f-4393-b409-fa094d7cf767'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-38f6a3d9-8ba2-4f7d-90eb-fb57bbf0ad4a tempest-ProjectReaderTests-25573969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-38f6a3d9-8ba2-4f7d-90eb-fb57bbf0ad4a tempest-ProjectReaderTests-25573969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-38f6a3d9-8ba2-4f7d-90eb-fb57bbf0ad4a tempest-ProjectReaderTests-25573969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:44 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-38f6a3d9-8ba2-4f7d-90eb-fb57bbf0ad4a tempest-ProjectReaderTests-25573969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-38f6a3d9-8ba2-4f7d-90eb-fb57bbf0ad4a tempest-ProjectReaderTests-25573969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:44 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38f6a3d9-8ba2-4f7d-90eb-fb57bbf0ad4a tempest-ProjectReaderTests-25573969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:44 devstack sudo[108902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:53:44 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:45 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-38f6a3d9-8ba2-4f7d-90eb-fb57bbf0ad4a tempest-ProjectReaderTests-25573969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.247s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-38f6a3d9-8ba2-4f7d-90eb-fb57bbf0ad4a tempest-ProjectReaderTests-25573969 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:45 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-38f6a3d9-8ba2-4f7d-90eb-fb57bbf0ad4a tempest-ProjectReaderTests-25573969 None] Deleted volume successfully.
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-38f6a3d9-8ba2-4f7d-90eb-fb57bbf0ad4a tempest-ProjectReaderTests-25573969 None] Lock "cinder-427f0753-847b-4d66-a763-af5caf803df4-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Flow 'volume_create_manager' (c4788bb1-b476-43c7-aed3-c4009a448442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6829899-a6e1-4910-9ab3-a9709151ccb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6829899-a6e1-4910-9ab3-a9709151ccb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-768306332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2179af-c78b-4ce4-ac4f-949720e78e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9605b31c914456ca266e88630487c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:46Z,use_quota=True,user_id='b61253654ed54bc5a6c59a130bedb682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6ef370-dca2-45db-8508-2fe78998a19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6ef370-dca2-45db-8508-2fe78998a19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c48e3cd-6d09-4e62-aac6-2b27e3acd677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c48e3cd-6d09-4e62-aac6-2b27e3acd677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab2179af-c78b-4ce4-ac4f-949720e78e9d', 'volume_name': 'volume-ab2179af-c78b-4ce4-ac4f-949720e78e9d', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0e153a-ab84-4a00-ae32-ddd8cc5dfb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0e153a-ab84-4a00-ae32-ddd8cc5dfb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e126b97c-2273-4fbe-b366-d2998d8836b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:45 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Volume ab2179af-c78b-4ce4-ac4f-949720e78e9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab2179af-c78b-4ce4-ac4f-949720e78e9d', 'volume_size': 1}
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-768306332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2179af-c78b-4ce4-ac4f-949720e78e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9605b31c914456ca266e88630487c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:46Z,use_quota=True,user_id='b61253654ed54bc5a6c59a130bedb682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Creating volume ab2179af-c78b-4ce4-ac4f-949720e78e9d {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:53:45 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:53:45 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab2179af-c78b-4ce4-ac4f-949720e78e9d 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:45 devstack sudo[108905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab2179af-c78b-4ce4-ac4f-949720e78e9d 1073741824
Nov 07 02:53:45 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:46 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab2179af-c78b-4ce4-ac4f-949720e78e9d 1073741824" returned: 0 in 0.403s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab2179af-c78b-4ce4-ac4f-949720e78e9d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:46 devstack sudo[108911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab2179af-c78b-4ce4-ac4f-949720e78e9d
Nov 07 02:53:46 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:46 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab2179af-c78b-4ce4-ac4f-949720e78e9d" returned: 0 in 0.244s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:46 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:53:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e126b97c-2273-4fbe-b366-d2998d8836b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab2179af-c78b-4ce4-ac4f-949720e78e9d', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73db3641-f3d5-4f4d-a206-6ae5b86fb3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:46 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Volume volume-ab2179af-c78b-4ce4-ac4f-949720e78e9d (ab2179af-c78b-4ce4-ac4f-949720e78e9d): created successfully
Nov 07 02:53:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73db3641-f3d5-4f4d-a206-6ae5b86fb3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:46 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Flow 'volume_create_manager' (c4788bb1-b476-43c7-aed3-c4009a448442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:46 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-b9581e1f-1f29-4a74-a5f7-203f8968ea20 tempest-ProjectReaderTests-25573969 None] Created volume successfully.
Nov 07 02:53:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-055f1e11-1a37-49ee-95a9-50bd1a629063 tempest-ProjectReaderTests-25573969 None] Acquiring lock "cinder-ab2179af-c78b-4ce4-ac4f-949720e78e9d-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-055f1e11-1a37-49ee-95a9-50bd1a629063 tempest-ProjectReaderTests-25573969 None] Lock "cinder-ab2179af-c78b-4ce4-ac4f-949720e78e9d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-055f1e11-1a37-49ee-95a9-50bd1a629063 tempest-ProjectReaderTests-25573969 None] Acquiring lock "cinder-quobyte-ab2179af-c78b-4ce4-ac4f-949720e78e9d" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:46 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-055f1e11-1a37-49ee-95a9-50bd1a629063 tempest-ProjectReaderTests-25573969 None] Lock "cinder-quobyte-ab2179af-c78b-4ce4-ac4f-949720e78e9d" acquired by "delete_volume" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:46 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99b81ce-7f5a-4ce1-85c8-0bea2ece1d46]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:46 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-055f1e11-1a37-49ee-95a9-50bd1a629063 tempest-ProjectReaderTests-25573969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab2179af-c78b-4ce4-ac4f-949720e78e9d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:46 devstack sudo[108914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab2179af-c78b-4ce4-ac4f-949720e78e9d
Nov 07 02:53:46 devstack sudo[108914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:47 devstack sudo[108914]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-055f1e11-1a37-49ee-95a9-50bd1a629063 tempest-ProjectReaderTests-25573969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab2179af-c78b-4ce4-ac4f-949720e78e9d" returned: 0 in 0.347s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-055f1e11-1a37-49ee-95a9-50bd1a629063 tempest-ProjectReaderTests-25573969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab2179af-c78b-4ce4-ac4f-949720e78e9d {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:47 devstack sudo[108919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab2179af-c78b-4ce4-ac4f-949720e78e9d
Nov 07 02:53:47 devstack sudo[108919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:47 devstack sudo[108919]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-055f1e11-1a37-49ee-95a9-50bd1a629063 tempest-ProjectReaderTests-25573969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-ab2179af-c78b-4ce4-ac4f-949720e78e9d" returned: 0 in 0.248s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-055f1e11-1a37-49ee-95a9-50bd1a629063 tempest-ProjectReaderTests-25573969 None] Lock "cinder-quobyte-ab2179af-c78b-4ce4-ac4f-949720e78e9d" released by "delete_volume" :: held 0.646s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:47 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-055f1e11-1a37-49ee-95a9-50bd1a629063 tempest-ProjectReaderTests-25573969 None] Created reservations ['9d774878-dd05-4b2c-acd0-239bec0be647', 'b375778f-16db-4213-9297-ab7b7887f1fb', '00ab93e5-bb7e-489c-b5c2-969d7bac32bb', 'f0eefef1-8558-4efe-aa49-f6983bea32bf'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-055f1e11-1a37-49ee-95a9-50bd1a629063 tempest-ProjectReaderTests-25573969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-055f1e11-1a37-49ee-95a9-50bd1a629063 tempest-ProjectReaderTests-25573969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-055f1e11-1a37-49ee-95a9-50bd1a629063 tempest-ProjectReaderTests-25573969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:47 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-055f1e11-1a37-49ee-95a9-50bd1a629063 tempest-ProjectReaderTests-25573969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-055f1e11-1a37-49ee-95a9-50bd1a629063 tempest-ProjectReaderTests-25573969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-055f1e11-1a37-49ee-95a9-50bd1a629063 tempest-ProjectReaderTests-25573969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:47 devstack sudo[108922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:53:47 devstack sudo[108922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:47 devstack sudo[108922]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:47 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-055f1e11-1a37-49ee-95a9-50bd1a629063 tempest-ProjectReaderTests-25573969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.251s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:47 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-055f1e11-1a37-49ee-95a9-50bd1a629063 tempest-ProjectReaderTests-25573969 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:47 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-055f1e11-1a37-49ee-95a9-50bd1a629063 tempest-ProjectReaderTests-25573969 None] Deleted volume successfully.
Nov 07 02:53:47 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-055f1e11-1a37-49ee-95a9-50bd1a629063 tempest-ProjectReaderTests-25573969 None] Lock "cinder-ab2179af-c78b-4ce4-ac4f-949720e78e9d-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Flow 'volume_create_manager' (bfbaeae1-fc17-4051-b032-948796d5f691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39191567-a821-4de8-b6d1-3a2bb5e478ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39191567-a821-4de8-b6d1-3a2bb5e478ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2050744736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81584583-0132-4300-bb50-52d82174b1ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9605b31c914456ca266e88630487c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:48Z,use_quota=True,user_id='b61253654ed54bc5a6c59a130bedb682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ad1d95-deab-416f-abfe-9c49281227cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ad1d95-deab-416f-abfe-9c49281227cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a2ab24-e00c-43fd-99d2-2bcbfbd3da70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a2ab24-e00c-43fd-99d2-2bcbfbd3da70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81584583-0132-4300-bb50-52d82174b1ad', 'volume_name': 'volume-81584583-0132-4300-bb50-52d82174b1ad', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c786511-f125-4563-b9a6-b7d0592302b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c786511-f125-4563-b9a6-b7d0592302b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4f46ed-5e9f-4fef-9f39-f3bd43546e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:48 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Volume 81584583-0132-4300-bb50-52d82174b1ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81584583-0132-4300-bb50-52d82174b1ad', 'volume_size': 1}
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2050744736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81584583-0132-4300-bb50-52d82174b1ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9605b31c914456ca266e88630487c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:48Z,use_quota=True,user_id='b61253654ed54bc5a6c59a130bedb682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Creating volume 81584583-0132-4300-bb50-52d82174b1ad {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:53:48 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-81584583-0132-4300-bb50-52d82174b1ad 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:48 devstack sudo[108926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-81584583-0132-4300-bb50-52d82174b1ad 1073741824
Nov 07 02:53:48 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:48 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-81584583-0132-4300-bb50-52d82174b1ad 1073741824" returned: 0 in 0.395s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:48 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-81584583-0132-4300-bb50-52d82174b1ad {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:48 devstack sudo[108931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-81584583-0132-4300-bb50-52d82174b1ad
Nov 07 02:53:48 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:49 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-81584583-0132-4300-bb50-52d82174b1ad" returned: 0 in 0.233s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:49 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] <== create_volume: return (665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:53:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:49 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4f46ed-5e9f-4fef-9f39-f3bd43546e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81584583-0132-4300-bb50-52d82174b1ad', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:49 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c2a74d-3e1f-4782-9c63-10924c70db43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:49 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Volume volume-81584583-0132-4300-bb50-52d82174b1ad (81584583-0132-4300-bb50-52d82174b1ad): created successfully
Nov 07 02:53:49 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c2a74d-3e1f-4782-9c63-10924c70db43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:49 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Flow 'volume_create_manager' (bfbaeae1-fc17-4051-b032-948796d5f691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:49 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-f0d241ca-6c4f-4a2a-9ae0-44689341ca4d tempest-ProjectReaderTests-25573969 None] Created volume successfully.
Nov 07 02:53:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8d888227-593a-4153-99a5-2b9c063bbd9c tempest-ProjectReaderTests-25573969 None] Acquiring lock "cinder-81584583-0132-4300-bb50-52d82174b1ad-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8d888227-593a-4153-99a5-2b9c063bbd9c tempest-ProjectReaderTests-25573969 None] Lock "cinder-81584583-0132-4300-bb50-52d82174b1ad-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8d888227-593a-4153-99a5-2b9c063bbd9c tempest-ProjectReaderTests-25573969 None] Acquiring lock "cinder-quobyte-81584583-0132-4300-bb50-52d82174b1ad" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:49 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8d888227-593a-4153-99a5-2b9c063bbd9c tempest-ProjectReaderTests-25573969 None] Lock "cinder-quobyte-81584583-0132-4300-bb50-52d82174b1ad" acquired by "delete_volume" :: waited 0.014s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:49 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e3af7c-10e9-407d-a401-a90737bc6631]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8d888227-593a-4153-99a5-2b9c063bbd9c tempest-ProjectReaderTests-25573969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-81584583-0132-4300-bb50-52d82174b1ad {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:49 devstack sudo[108934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-81584583-0132-4300-bb50-52d82174b1ad
Nov 07 02:53:49 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:49 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8d888227-593a-4153-99a5-2b9c063bbd9c tempest-ProjectReaderTests-25573969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-81584583-0132-4300-bb50-52d82174b1ad" returned: 0 in 0.349s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:49 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8d888227-593a-4153-99a5-2b9c063bbd9c tempest-ProjectReaderTests-25573969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-81584583-0132-4300-bb50-52d82174b1ad {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:49 devstack sudo[108939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-81584583-0132-4300-bb50-52d82174b1ad
Nov 07 02:53:49 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:50 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8d888227-593a-4153-99a5-2b9c063bbd9c tempest-ProjectReaderTests-25573969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-81584583-0132-4300-bb50-52d82174b1ad" returned: 0 in 0.243s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8d888227-593a-4153-99a5-2b9c063bbd9c tempest-ProjectReaderTests-25573969 None] Lock "cinder-quobyte-81584583-0132-4300-bb50-52d82174b1ad" released by "delete_volume" :: held 0.633s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-8d888227-593a-4153-99a5-2b9c063bbd9c tempest-ProjectReaderTests-25573969 None] Created reservations ['535b9fa2-683a-4467-afdd-749692a00c56', 'd9bc01c9-f5ba-4ecf-8a9a-9d9852e28bd4', 'bb65a874-a169-406d-8f2c-f04e14b2a3ae', 'f4ad666c-ed26-4037-9a07-51fb314bb9f2'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8d888227-593a-4153-99a5-2b9c063bbd9c tempest-ProjectReaderTests-25573969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8d888227-593a-4153-99a5-2b9c063bbd9c tempest-ProjectReaderTests-25573969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8d888227-593a-4153-99a5-2b9c063bbd9c tempest-ProjectReaderTests-25573969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-8d888227-593a-4153-99a5-2b9c063bbd9c tempest-ProjectReaderTests-25573969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-8d888227-593a-4153-99a5-2b9c063bbd9c tempest-ProjectReaderTests-25573969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8d888227-593a-4153-99a5-2b9c063bbd9c tempest-ProjectReaderTests-25573969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:50 devstack sudo[108942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:53:50 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:50 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-8d888227-593a-4153-99a5-2b9c063bbd9c tempest-ProjectReaderTests-25573969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.246s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-8d888227-593a-4153-99a5-2b9c063bbd9c tempest-ProjectReaderTests-25573969 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:50 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-8d888227-593a-4153-99a5-2b9c063bbd9c tempest-ProjectReaderTests-25573969 None] Deleted volume successfully.
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-8d888227-593a-4153-99a5-2b9c063bbd9c tempest-ProjectReaderTests-25573969 None] Lock "cinder-81584583-0132-4300-bb50-52d82174b1ad-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87054) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Flow 'volume_create_manager' (76834319-a9b0-47a6-b314-f15a3bab4ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a7b101-2179-426e-b113-95995d9403a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a7b101-2179-426e-b113-95995d9403a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1092517851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d80a618e-69dc-4d2d-81e0-b580a69978c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9605b31c914456ca266e88630487c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:51Z,use_quota=True,user_id='b61253654ed54bc5a6c59a130bedb682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d029bf-d511-447f-b74b-6be240ce7f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d029bf-d511-447f-b74b-6be240ce7f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (225747d5-376f-4d4f-81c3-9861e1d3d8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (225747d5-376f-4d4f-81c3-9861e1d3d8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd80a618e-69dc-4d2d-81e0-b580a69978c1', 'volume_name': 'volume-d80a618e-69dc-4d2d-81e0-b580a69978c1', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf9a2ca-dd6c-4f41-909f-6ff448a1edbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf9a2ca-dd6c-4f41-909f-6ff448a1edbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726e2f2d-019f-4a76-bc16-a2a171bd9676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:50 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Volume d80a618e-69dc-4d2d-81e0-b580a69978c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d80a618e-69dc-4d2d-81e0-b580a69978c1', 'volume_size': 1}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72170aa3ab40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-07T01:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1092517851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d80a618e-69dc-4d2d-81e0-b580a69978c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9605b31c914456ca266e88630487c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-07T01:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-07T01:53:51Z,use_quota=True,user_id='b61253654ed54bc5a6c59a130bedb682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b15e740-c0e9-4da8-84f4-b86f72d059df),volume_type_id=9b15e740-c0e9-4da8-84f4-b86f72d059df)}" {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.remotefs [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Creating volume d80a618e-69dc-4d2d-81e0-b580a69978c1 {{(pid=87054) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Selected osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c as target Quobyte volume. {{(pid=87054) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 07 02:53:50 devstack cinder-volume[87054]: INFO cinder.volume.drivers.remotefs [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] casted to osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c
Nov 07 02:53:50 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d80a618e-69dc-4d2d-81e0-b580a69978c1 1073741824 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:51 devstack sudo[108945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d80a618e-69dc-4d2d-81e0-b580a69978c1 1073741824
Nov 07 02:53:51 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:51 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d80a618e-69dc-4d2d-81e0-b580a69978c1 1073741824" returned: 0 in 0.403s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d80a618e-69dc-4d2d-81e0-b580a69978c1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:51 devstack sudo[108951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d80a618e-69dc-4d2d-81e0-b580a69978c1
Nov 07 02:53:51 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:51 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d80a618e-69dc-4d2d-81e0-b580a69978c1" returned: 0 in 0.238s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:51 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'} {{(pid=87054) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 07 02:53:51 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:51 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726e2f2d-019f-4a76-bc16-a2a171bd9676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d80a618e-69dc-4d2d-81e0-b580a69978c1', 'volume_size': 1}' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:51 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84cde3db-feff-4ffa-a047-efe7233aaf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 07 02:53:51 devstack cinder-volume[87054]: INFO cinder.volume.flows.manager.create_volume [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Volume volume-d80a618e-69dc-4d2d-81e0-b580a69978c1 (d80a618e-69dc-4d2d-81e0-b580a69978c1): created successfully
Nov 07 02:53:51 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84cde3db-feff-4ffa-a047-efe7233aaf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87054) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 07 02:53:51 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Flow 'volume_create_manager' (76834319-a9b0-47a6-b314-f15a3bab4ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87054) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 07 02:53:51 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-c6369757-2149-47ea-910b-4aa5ae74c0c0 tempest-ProjectReaderTests-25573969 None] Created volume successfully.
Nov 07 02:53:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3818aaef-f166-4756-8fd9-47a93cdf1d0f tempest-ProjectReaderTests-25573969 None] Acquiring lock "cinder-d80a618e-69dc-4d2d-81e0-b580a69978c1-delete_volume" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3818aaef-f166-4756-8fd9-47a93cdf1d0f tempest-ProjectReaderTests-25573969 None] Lock "cinder-d80a618e-69dc-4d2d-81e0-b580a69978c1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:51 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3818aaef-f166-4756-8fd9-47a93cdf1d0f tempest-ProjectReaderTests-25573969 None] Acquiring lock "cinder-quobyte-d80a618e-69dc-4d2d-81e0-b580a69978c1" by "delete_volume" {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 07 02:53:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3818aaef-f166-4756-8fd9-47a93cdf1d0f tempest-ProjectReaderTests-25573969 None] Lock "cinder-quobyte-d80a618e-69dc-4d2d-81e0-b580a69978c1" acquired by "delete_volume" :: waited 0.016s {{(pid=87054) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 07 02:53:52 devstack cinder-volume[87054]: DEBUG oslo.privsep.daemon [-] privsep: reply[5506d1a9-323f-42e1-b043-55e714e656fd]: (4, 'qcow2') {{(pid=88768) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 07 02:53:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3818aaef-f166-4756-8fd9-47a93cdf1d0f tempest-ProjectReaderTests-25573969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d80a618e-69dc-4d2d-81e0-b580a69978c1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:52 devstack sudo[108954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d80a618e-69dc-4d2d-81e0-b580a69978c1
Nov 07 02:53:52 devstack sudo[108954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:52 devstack sudo[108954]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3818aaef-f166-4756-8fd9-47a93cdf1d0f tempest-ProjectReaderTests-25573969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d80a618e-69dc-4d2d-81e0-b580a69978c1" returned: 0 in 0.345s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3818aaef-f166-4756-8fd9-47a93cdf1d0f tempest-ProjectReaderTests-25573969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d80a618e-69dc-4d2d-81e0-b580a69978c1 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:52 devstack sudo[108959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d80a618e-69dc-4d2d-81e0-b580a69978c1
Nov 07 02:53:52 devstack sudo[108959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:52 devstack sudo[108959]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3818aaef-f166-4756-8fd9-47a93cdf1d0f tempest-ProjectReaderTests-25573969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79/volume-d80a618e-69dc-4d2d-81e0-b580a69978c1" returned: 0 in 0.238s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:52 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3818aaef-f166-4756-8fd9-47a93cdf1d0f tempest-ProjectReaderTests-25573969 None] Lock "cinder-quobyte-d80a618e-69dc-4d2d-81e0-b580a69978c1" released by "delete_volume" :: held 0.624s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:52 devstack cinder-volume[87054]: DEBUG cinder.quota [None req-3818aaef-f166-4756-8fd9-47a93cdf1d0f tempest-ProjectReaderTests-25573969 None] Created reservations ['3f2bbc44-0ba8-4c8f-aa8f-aba6826cd4a3', '92f730e8-92ef-4db3-83ef-0b1a04ece2c7', 'd5787ee1-76e8-4c5f-9c48-21f808a22d65', '4fd55442-41d1-487d-a218-6a9731e88c67'] {{(pid=87054) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 07 02:53:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3818aaef-f166-4756-8fd9-47a93cdf1d0f tempest-ProjectReaderTests-25573969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 07 02:53:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3818aaef-f166-4756-8fd9-47a93cdf1d0f tempest-ProjectReaderTests-25573969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 07 02:53:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3818aaef-f166-4756-8fd9-47a93cdf1d0f tempest-ProjectReaderTests-25573969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c': None} {{(pid=87054) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 07 02:53:52 devstack cinder-volume[87054]: DEBUG cinder.volume.drivers.quobyte [None req-3818aaef-f166-4756-8fd9-47a93cdf1d0f tempest-ProjectReaderTests-25573969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-85fc109d-c623-4fd1-87c1-9a7448cfd91c'] {{(pid=87054) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 07 02:53:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.lockutils [None req-3818aaef-f166-4756-8fd9-47a93cdf1d0f tempest-ProjectReaderTests-25573969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87054) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 07 02:53:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3818aaef-f166-4756-8fd9-47a93cdf1d0f tempest-ProjectReaderTests-25573969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79 {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 07 02:53:52 devstack sudo[108962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79
Nov 07 02:53:52 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 07 02:53:52 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root
Nov 07 02:53:52 devstack cinder-volume[87054]: DEBUG oslo_concurrency.processutils [None req-3818aaef-f166-4756-8fd9-47a93cdf1d0f tempest-ProjectReaderTests-25573969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/71a6e77624b3b642aabc981726f96f79" returned: 0 in 0.240s {{(pid=87054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 07 02:53:52 devstack cinder-volume[87054]: DEBUG cinder.manager [None req-3818aaef-f166-4756-8fd9-47a93cdf1d0f tempest-ProjectReaderTests-25573969 None] Notifying Schedulers of capabilities ... {{(pid=87054) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 07 02:53:52 devstack cinder-volume[87054]: INFO cinder.volume.manager [None req-3818aaef-f166-4756-8fd9-47a93cdf1d0f tempest-ProjectReaderTests-25573969 None] Deleted volume successfully.
Nov 07 02:53:53 devstack cinder-volume[87054]: DEBUG cinder.coordination [None req-3818aaef-f166-4756-8fd9-47a93cdf1d0f tempest-ProjectReaderTests-25573969 None] Lock "cinder-d80a618e-69dc-4d2d-81e0-b580a69978c1-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=87054) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 07 02:53:59 devstack cinder-volume[87054]: DEBUG oslo_service.periodic_task [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] Running periodic task VolumeManager._thread_info {{(pid=87054) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 07 02:53:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread count: 28 {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 07 02:53:59 devstack cinder-volume[87054]: DEBUG cinder.volume.manager [None req-6df3cd1c-24cd-4de2-985a-eadb1db6942a None None] thread info: [<_MainThread(MainThread, started 125443401228416)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125443287091392)>, <Thread(Thread-3 (stat_writer), started daemon 125443289493184)>, <Thread(Rabbit-heartbeat, started daemon 125443286876672)>, <Thread(Thread-5 (_runner), started daemon 125443286914240)>, <Thread(Thread-7 (_runner), started daemon 125443284980160)>, <Thread(fd_logger, started daemon 125443282798592)>, <Thread(privsep_reader, started daemon 125443284556288)>, <Thread(tpool_thread_0, started daemon 125443276445376)>, <Thread(tpool_thread_1, started daemon 125443268036288)>, <Thread(tpool_thread_2, started daemon 125443259627200)>, <Thread(tpool_thread_3, started daemon 125443251218112)>, <Thread(tpool_thread_4, started daemon 125443242809024)>, <Thread(tpool_thread_5, started daemon 125443234399936)>, <Thread(tpool_thread_6, started daemon 125443225990848)>, <Thread(tpool_thread_7, started daemon 125443217581760)>, <Thread(tpool_thread_8, started daemon 125443209172672)>, <Thread(tpool_thread_9, started daemon 125443200763584)>, <Thread(tpool_thread_10, started daemon 125443192354496)>, <Thread(tpool_thread_11, started daemon 125443183945408)>, <Thread(tpool_thread_12, started daemon 125443175536320)>, <Thread(tpool_thread_13, started daemon 125443167127232)>, <Thread(tpool_thread_14, started daemon 125443158718144)>, <Thread(tpool_thread_15, started daemon 125443150309056)>, <Thread(tpool_thread_16, started daemon 125443141899968)>, <Thread(tpool_thread_17, started daemon 125443133490880)>, <Thread(tpool_thread_18, started daemon 125443125081792)>, <Thread(tpool_thread_19, started daemon 125443116672704)>] {{(pid=87054) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 07 02:54:02 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:SELECT=32,cinder:UPDATE=47,cinder:DELETE=1,cinder:INSERT=9 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 07 02:54:02 devstack cinder-volume[87054]: DEBUG dbcounter [-] [87054] Writing DB stats cinder:UPDATE=42,cinder:SELECT=25,cinder:INSERT=11,cinder:DELETE=7 {{(pid=87054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}